-- Logs begin at Thu 2022-09-01 15:47:40 UTC, end at Thu 2022-09-01 17:01:51 UTC. -- Sep 01 16:22:19.845630 dv-cinder-852208-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:22:19.854589 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:22:19 2022] *** Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: nodename: dv-cinder-852208-16-iscsi Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: machine: x86_64 Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: clock source: unix Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: pcre jit disabled Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: detected number of CPU cores: 4 Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: current working directory: / Sep 01 16:22:19.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: your processes number limit is 47680 Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: your memory page size is 4096 bytes Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: detected max file descriptor number: 2048 Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: lock engine: pthread robust mutexes Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: thunder lock: enabled Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:22:19.857415 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:22:19.896953 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: Python main interpreter initialized at 0x555820aca9c0 Sep 01 16:22:19.896953 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: python threads support enabled Sep 01 16:22:19.896953 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: your server socket listen backlog is limited to 100 connections Sep 01 16:22:19.896953 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:22:19.897388 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:22:19.897388 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: *** Operational MODE: preforking *** Sep 01 16:22:19.897648 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:22:19.897648 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: spawned uWSGI master process (pid: 105498) Sep 01 16:22:19.897865 dv-cinder-852208-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:22:19.898999 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: spawned uWSGI worker 1 (pid: 105499, cores: 1) Sep 01 16:22:19.898999 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: spawned uWSGI worker 2 (pid: 105500, cores: 1) Sep 01 16:22:19.898999 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:22:20.549677 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:22:20.563017 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:22:21.618415 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:22:21.618415 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: from cryptography.utils import int_from_bytes Sep 01 16:22:21.619012 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:22:21.619012 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: from cryptography.utils import int_from_bytes Sep 01 16:22:21.629441 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:22:21.629441 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: from cryptography.utils import int_from_bytes Sep 01 16:22:21.629904 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:22:21.629904 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: from cryptography.utils import int_from_bytes Sep 01 16:22:24.127632 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:22:24.128164 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:22:24.128390 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:22:24.128748 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:22:24.128999 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:22:24.129380 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.129704 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.130023 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.130364 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.130696 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.131002 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.131844 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.132161 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.132485 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.132742 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.133053 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.133373 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-16-iscsi {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.133691 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.133994 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.134263 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:22:24.134714 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.134810 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:22:24.134908 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.134908 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.135083 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:22:24.135222 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.135388 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:22:24.135523 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.135648 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:22:24.136018 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.136132 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.136356 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.136444 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.136680 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.136798 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137000 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137116 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137348 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137548 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137649 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137747 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.137951 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138050 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138289 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138390 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138605 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138742 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138876 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.138963 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.139191 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.139286 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.139516 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-16-iscsi {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.139615 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-16-iscsi {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.139841 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.139928 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.140150 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.140238 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.140460 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.140546 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.140778 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.140876 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.141083 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.141217 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.141407 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.141494 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.141724 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.141815 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.142059 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.142242 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.142393 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.142559 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.142716 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.142864 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143031 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143174 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143344 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143508 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143659 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143823 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.143957 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.144118 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.144259 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.144437 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.144563 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.144746 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.144894 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.145067 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.145175 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.145376 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.145465 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.145704 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.145802 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-16-iscsi {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.146004 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.146092 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.146346 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.146453 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.146664 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.146761 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.147592 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.147735 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.147849 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.147956 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.148084 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.148233 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.148397 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.148553 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.148712 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.148882 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149013 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149191 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149315 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149518 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149605 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149838 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.149933 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.150155 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.150259 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.150500 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.150589 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.150799 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.150894 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.151100 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.151187 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.151406 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.151496 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.151714 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.151802 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152017 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152146 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152319 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152405 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152566 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152654 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.152872 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153010 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153193 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153287 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153512 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153612 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153832 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.153924 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154084 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154182 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154354 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154482 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154663 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154796 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.154983 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.155112 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.155292 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.155415 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.155599 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.155718 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.155906 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156007 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156213 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156309 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156519 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156635 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156824 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.156936 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.157129 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.157226 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.157436 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.157529 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.157751 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.157845 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.158063 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.158225 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.158385 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.158480 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.158687 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.158775 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.159258 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.159369 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.159551 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.159670 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.159852 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.159940 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.160153 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.160240 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.160458 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.160544 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.160758 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.160846 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161058 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161153 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161355 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161460 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161651 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161738 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.161951 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.162038 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.162272 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.162380 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.162667 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.162780 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.162983 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163070 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163317 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163414 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163617 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163709 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163864 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.163950 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.164168 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.164265 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.164476 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.164570 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.164795 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.164882 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165092 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165257 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165392 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165480 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165695 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165780 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.165991 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.166089 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.166316 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.166406 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.166624 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.166709 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.166925 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167020 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167226 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167320 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167533 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167620 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167826 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.167922 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.168127 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.168214 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.168432 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.168523 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.168732 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.168826 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169033 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169119 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169328 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169416 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169626 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169722 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.169924 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170017 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170248 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170393 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170555 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170667 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170852 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.170961 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.171147 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.171248 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.171459 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.171561 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.171814 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.171920 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172067 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172163 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172368 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172456 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172669 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172757 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.172979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.173075 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.173284 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.173371 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.173601 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.173690 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.173910 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.174044 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.174241 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.174337 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.174538 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.174625 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.174854 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.174953 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.175162 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.175258 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.175468 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.175561 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.175771 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.175860 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.176074 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.176170 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.176377 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.176470 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.176680 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.176781 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.176982 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.177067 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.177282 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.177366 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.177581 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.177669 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.177896 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.177982 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.178248 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.178339 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.178561 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.178653 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.178871 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.178959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.179174 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.179274 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.179489 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.179576 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:22:24.179811 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.179900 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.180125 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.180220 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.180431 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.180530 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.180769 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.180870 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.181100 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.181196 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.181407 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.181500 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.181728 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.181819 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182038 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182138 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182366 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182456 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182674 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182769 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.182978 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183076 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183284 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183371 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183596 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183691 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183901 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.183996 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.184217 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.184314 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.184527 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.184625 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.184842 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.184937 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.185148 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.185243 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.185457 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.185549 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.185762 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.185850 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.186066 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.186152 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.186401 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.186489 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.186725 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.186822 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187035 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187129 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187412 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187517 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187663 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187761 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.187973 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188061 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188280 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188406 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188580 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188673 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188886 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.188996 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.189189 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.189289 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.189486 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.189583 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.189791 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.189891 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.190081 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.190185 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.190411 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.190513 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.190715 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.190813 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191030 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191129 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191353 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191443 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191654 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191742 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.191960 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192071 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192263 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192353 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192570 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192667 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192875 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.192965 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.193178 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.193267 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.193475 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.193564 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.194339 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.194455 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.194631 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.194721 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.194934 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.195080 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.195285 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.195591 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.195892 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.196210 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.196297 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.196510 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.196613 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.196810 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.196900 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.197119 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.197207 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.197424 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.197514 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.197730 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.197826 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198037 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198127 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198365 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198467 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198669 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198758 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.198978 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.199073 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.199284 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.199375 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.199605 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.199714 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.199930 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200019 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200233 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200332 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200544 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200634 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200869 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.200971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.201182 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.201273 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.201483 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.201573 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.201787 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.201889 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.202090 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.202239 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.202414 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.202517 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.202715 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.202825 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203021 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203129 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203319 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203408 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203619 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203717 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.203917 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204013 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204215 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204311 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204514 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204616 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204825 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.204929 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.205126 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.205215 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.205425 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.205521 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.205724 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.205820 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.206023 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.206120 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.206386 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.206479 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.206690 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.206778 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207027 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207114 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207355 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207445 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207660 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207747 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.207975 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208073 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208283 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208373 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208594 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208689 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208897 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.208997 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.209200 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.209289 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.210064 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.210233 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.210397 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.210499 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.210721 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.210811 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211030 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211120 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211336 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211435 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211641 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211737 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.211946 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212034 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212255 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212358 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212559 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212657 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212860 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.212948 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.213173 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.213270 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.213477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.213567 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.213784 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.213880 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.214092 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.214229 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.214455 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.214559 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.214764 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.214915 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215073 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215163 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215379 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215469 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215686 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215784 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.215994 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.216091 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.216300 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.216397 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.216615 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.216784 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.216923 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217013 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217236 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217332 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217543 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217640 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217854 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.217943 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.218159 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.218278 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.218496 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.218604 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.218798 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.218929 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.219107 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.219206 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.219431 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.219530 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.219746 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.219834 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220049 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220137 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220355 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220445 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220669 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220757 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.220972 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221073 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221277 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221375 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221582 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221672 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221881 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.221970 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.222179 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.222345 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.222509 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.222608 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.222817 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.222907 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.223122 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.223222 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.223428 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.223519 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.223726 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.223824 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224034 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224125 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224336 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224432 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224634 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224737 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.224930 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225022 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225282 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225381 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225600 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225701 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225904 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.225992 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.226229 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.226349 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.226552 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.226670 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.226858 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.226955 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.227158 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.227273 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.227477 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.227579 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.227781 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.227889 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228081 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228190 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228380 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228480 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228678 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228778 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.228987 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.229088 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.229294 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.229385 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.229593 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.229681 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.229900 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230000 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230233 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230328 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230549 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230628 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230857 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.230948 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.231160 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.231245 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.231464 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.231543 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.231771 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.231860 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.232079 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.232159 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.232382 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.232459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.232781 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.232900 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.233016 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.233252 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.233355 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.233633 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.233722 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.233957 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.234256 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.234373 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.234660 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.234836 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.234989 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.235302 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.235439 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.235608 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.235767 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.235914 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.236100 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.236277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.236398 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.236639 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.236719 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.236955 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.237044 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.237262 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.237580 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.237656 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.237902 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.237980 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.238232 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.238344 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.238550 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.238631 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.238863 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.238947 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.239174 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.239322 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.239547 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.239652 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.239813 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.239905 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.240126 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.240249 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.240473 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.240570 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.241303 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.241426 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.241606 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.241696 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.241912 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242000 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242257 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242364 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242549 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242640 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242854 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.242955 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.243159 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.243237 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.243462 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.243559 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.243774 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.243864 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.244060 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.244182 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.244430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.244645 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.244807 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.244987 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.245215 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.245407 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.245562 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.245714 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.245879 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.245995 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.246080 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.246177 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.246500 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.246603 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.246802 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.247105 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.247194 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.247408 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.247587 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.247761 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.247901 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.248055 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.248216 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.248392 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.248717 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.248806 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.249062 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.249227 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.249444 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.249719 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.249893 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.250045 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.250269 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.250426 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.250579 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.250757 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.250919 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251076 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251242 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251381 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251479 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251576 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251660 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251748 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251829 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.251998 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.252303 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.252410 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.252608 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.252912 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.253007 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.253210 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.253486 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.253599 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.253800 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.253897 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.254109 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.254326 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.254419 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.254719 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.254913 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.255002 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.255308 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.255526 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.255629 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.255895 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.256126 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.256214 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257026 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257169 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257339 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257497 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257639 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257818 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.257937 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.258177 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.258321 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.258529 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.258620 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.258842 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.258938 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.259142 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.259456 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.259546 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.259760 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.259933 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.260059 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.260257 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.260417 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.260578 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.260754 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261005 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261144 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261323 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261415 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261639 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261729 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.261954 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.262044 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.262291 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.262385 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.262595 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.262696 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.262904 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263003 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263207 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263340 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263510 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263634 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263812 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.263991 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.264146 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.264299 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.264450 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.264610 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.264773 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.264937 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.265177 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.265397 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.265550 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.265704 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.265844 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.265945 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.266037 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.266120 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.266370 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.266657 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.266758 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.266962 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.267243 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.267332 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.267588 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.267684 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.267888 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.267982 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.268246 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.268325 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.268550 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.268629 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.268863 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.268943 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.269370 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.269470 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.269684 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.269944 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.270122 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.270323 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.270477 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.270642 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.270794 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.270947 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.271116 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.271278 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.271435 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.271590 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.271741 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.271943 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272095 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272242 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272389 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272554 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272709 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272871 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.272986 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.273078 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.273161 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.273506 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.273685 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.273854 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.274132 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.274310 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.274458 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.274764 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.274937 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.275072 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.275378 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.275549 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.275671 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.275980 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.276139 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.276376 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.276533 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.276695 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.276837 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.277011 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.277120 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.277362 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.277582 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.277669 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.277958 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.278174 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.278300 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.278585 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.278798 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.278886 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.279190 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.279395 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.279491 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.279785 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.279975 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.280088 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.280404 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.280581 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.280731 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.280875 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.281130 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.281300 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.281469 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.281667 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.281862 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.282027 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.282119 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.282235 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.282484 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.282669 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.282988 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.283270 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.283377 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.283595 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.283794 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.284144 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.284439 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.284653 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.284852 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.285161 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.285257 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.285473 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.285679 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.285783 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.286062 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.286209 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.286383 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.286688 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.286775 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.287005 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.287202 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.287288 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.287615 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.287731 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.287914 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.288219 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.288306 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.288516 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.288722 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.288832 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.289213 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.289301 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.289536 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.289770 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.289883 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.290209 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.290302 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.290545 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.290776 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.290873 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.291155 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.291285 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.291472 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.291782 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.291881 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.292085 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.292287 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.292396 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.292701 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.292795 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.293018 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.293295 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.293384 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.293635 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.293809 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.293945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.294271 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.294364 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.294593 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.294798 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.294912 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.295224 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.295326 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.295598 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.295755 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.295952 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.296237 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.296326 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.296571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.296731 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.296933 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.297204 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.297300 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.297504 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.297701 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.297790 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.298097 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.298184 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.298422 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299121 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299226 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299309 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299389 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299389 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299534 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299622 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.299704 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.304871 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.304996 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305091 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305175 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305266 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305351 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305433 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305503 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305659 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305737 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305831 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305909 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.305980 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306048 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306124 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306218 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306306 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306391 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306461 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306529 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306597 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306665 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306745 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306816 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306896 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.306966 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307033 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307108 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307187 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307258 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307325 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307399 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307469 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307543 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307619 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307696 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307696 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307830 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307900 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.307969 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308051 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308128 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308197 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308264 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308331 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308406 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308476 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308542 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308609 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308676 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308742 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308817 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308886 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.308953 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309034 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309128 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309223 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309315 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309398 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309486 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309637 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309769 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.309936 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.310044 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.310258 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.310452 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.310542 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.310768 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.310879 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.311077 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.311168 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.311425 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.311520 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.311730 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.311827 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312047 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312137 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312354 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312452 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312649 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312752 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.312946 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313044 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313243 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313332 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313577 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313676 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313875 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.313976 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.314237 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.314331 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.314521 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.314620 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.314843 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.314956 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.315157 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.315258 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.315462 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.315552 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.315768 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.315855 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.316076 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.316167 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.316385 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.316475 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.316696 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.316784 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317006 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317104 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317315 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317417 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317625 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317714 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.317936 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.318075 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.318268 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.318363 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.318663 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.319465 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.319569 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.319798 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.319898 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.320113 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.320202 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.320427 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.320516 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.320738 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.320828 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321042 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321129 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321348 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321657 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321746 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.321963 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.322051 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.322288 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.322396 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.322599 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.322686 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.322917 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323004 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323222 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323318 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323539 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323628 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323853 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.323939 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.324174 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.324275 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.324487 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.324576 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.324790 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.324877 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.325099 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.325209 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.325414 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.325512 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.325718 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.325808 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326026 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326117 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326356 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326445 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326670 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326759 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.326979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327069 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327288 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327398 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327595 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327705 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327900 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.327988 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.328209 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.328297 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.328517 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.328614 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.328824 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.328913 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.329135 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.329223 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.329445 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.329553 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.329760 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.329900 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.330083 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.330173 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.330416 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.330508 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.330725 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.330811 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331027 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331113 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331334 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331423 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331638 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331852 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.331941 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.332163 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.332261 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.332492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.332581 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.332815 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.332943 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.333132 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.333296 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.333433 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.333522 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.333749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.333837 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.334058 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.334150 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.334423 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.334517 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.334735 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.334861 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.335040 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.335153 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.335384 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.335526 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.335693 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.335782 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336023 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336114 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336338 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336434 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336637 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336725 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.336955 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.337045 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.337262 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.337351 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.337575 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.337793 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.337886 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.338139 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.338260 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.338479 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.338568 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.338802 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.338891 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.339123 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.339210 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.339435 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.339522 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.339739 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.339841 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.340052 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.340140 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.340355 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.340611 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.340708 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.340954 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341063 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341254 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341353 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341556 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341646 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341863 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.341952 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.342172 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.342328 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.342502 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.342592 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.342804 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.342893 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.343112 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.343200 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.343414 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.343511 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.343724 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.343820 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344029 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344129 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344331 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344419 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344631 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344764 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.344938 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345036 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345238 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345374 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345538 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345628 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345838 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.345935 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.346138 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.346246 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.346472 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.346562 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.346775 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.346864 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347082 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347169 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347382 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347478 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347688 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347815 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.347989 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.348086 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.348345 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.348435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.348646 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.348744 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.348963 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349058 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349267 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349368 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349566 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349655 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349877 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.349966 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.350232 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.350337 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.350556 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.350652 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.350866 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.350963 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.351174 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.351272 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.351511 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.351606 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.351828 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.351924 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.352145 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.352360 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.352453 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.352699 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.352968 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.353057 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.353287 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.353377 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.353622 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.353766 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.353950 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.354039 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.354291 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.354384 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.354625 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.354714 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.354952 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355043 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355266 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355357 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355577 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355666 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355882 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.355978 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.356188 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.356277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.356496 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.356591 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.356801 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.356898 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.357109 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.357206 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.357418 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.357506 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.357723 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.357825 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358031 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358135 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358359 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358462 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358667 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358892 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.358981 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.359243 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.359332 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.359564 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.359664 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.359891 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.359979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.360205 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.360294 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.360521 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.360618 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.360827 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.360914 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.361137 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.361231 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.361443 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.361540 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.361747 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.361835 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362050 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362137 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362384 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362556 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362691 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362779 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.362999 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.363088 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.363311 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.363400 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.363613 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.363703 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.363914 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364010 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364228 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364326 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364534 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364630 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364866 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.364956 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.365175 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.365266 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.365483 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.366065 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.366379 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.366515 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.366988 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367302 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367393 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367475 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367555 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367646 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367736 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367818 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.367910 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368040 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368226 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368326 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368549 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368640 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368852 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.368941 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.369154 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.369256 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.369454 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.369543 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.369762 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.369852 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.370077 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.370166 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.370409 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.370510 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.370711 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.370800 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371010 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371107 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371315 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371410 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371614 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371711 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.371916 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372014 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372220 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372310 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372520 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372616 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372825 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.372922 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.373122 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.373212 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.373422 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.373518 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.373720 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.373990 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.374079 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.374324 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.374415 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.374625 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.374716 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.374931 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375061 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375231 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375334 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375531 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375621 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375827 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.375916 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.376124 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.376222 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.376422 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.376521 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.376746 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.376836 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377172 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377383 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377472 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377697 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377786 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.377999 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.378136 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.378334 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.378423 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.378640 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.378728 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.378946 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379045 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379257 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379348 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379565 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379654 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379870 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.379961 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.380178 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.380273 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.380489 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.380578 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.380794 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.380890 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.381100 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.381189 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.381961 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.382067 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.382296 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.382391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.382606 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.382695 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.382929 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383029 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383253 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383341 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383552 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383639 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383862 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.383958 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.384173 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.384261 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.384483 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.384572 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.384792 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.384892 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.385101 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.385197 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.385420 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.385508 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.385724 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.385813 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386031 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386140 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386358 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386480 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386666 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386802 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.386972 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.387125 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.387282 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.387437 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.387589 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.387760 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.387894 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.388086 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.388205 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.388399 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.388514 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.388722 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.388836 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.389036 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.389156 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.389366 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.389463 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.389709 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.389798 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.390046 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.390134 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.390399 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.390492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.390711 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.390800 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391019 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391107 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391327 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391426 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391639 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391730 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.391951 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.392111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.392253 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.392342 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.392493 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:22:24.392581 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.392841 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.393152 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.393457 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.393764 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.394069 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.394400 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.394711 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.395015 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.395318 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.395622 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.395927 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.396231 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.396536 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.396869 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.397175 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.397481 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.397784 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.398088 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.398417 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.398750 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.399085 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.399400 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.399722 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.400040 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.400364 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.400675 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.400995 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.401317 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.401632 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.401941 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.402299 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.402614 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.402925 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.403238 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.403551 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.403861 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.404169 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.404496 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.404821 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.405129 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.405454 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.405772 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.406096 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.406433 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.406749 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.407078 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.407391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.407703 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.408012 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.408321 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.408632 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.409211 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.409521 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.409833 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.410153 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.410494 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.410821 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.411148 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.411461 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.411788 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.412114 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.412484 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.412801 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.413142 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.413472 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.413789 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.414103 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.414435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:22:24.414682 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:22:24.545606 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO dbcounter [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Registered counter for database nova_api Sep 01 16:22:24.565955 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_db.sqlalchemy.engines [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.568081 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Registered counter for database nova_api Sep 01 16:22:24.572411 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writer thread running {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.588143 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.594759 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.635109 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.context [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),821da9c6-175b-449b-a524-866ff6db58f0(cell1) {{(pid=105499) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:22:24.638986 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_concurrency.lockutils [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:22:24.639461 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_concurrency.lockutils [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:22:24.640989 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_concurrency.lockutils [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:22:24.641706 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_concurrency.lockutils [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:22:24.642149 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_concurrency.lockutils [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:22:24.644155 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_concurrency.lockutils [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:22:24.646120 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO dbcounter [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Registered counter for database nova_cell0 Sep 01 16:22:24.650805 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO dbcounter [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Registered counter for database nova_cell1 Sep 01 16:22:24.652985 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.context [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),821da9c6-175b-449b-a524-866ff6db58f0(cell1) {{(pid=105500) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:22:24.657060 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:22:24.657544 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:22:24.657797 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_db.sqlalchemy.engines [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.659425 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:22:24.660146 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:22:24.660307 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_db.sqlalchemy.engines [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.660594 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:22:24.662662 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:22:24.664671 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Registered counter for database nova_cell0 Sep 01 16:22:24.666945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writer thread running {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.668455 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writer thread running {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.670177 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Registered counter for database nova_cell1 Sep 01 16:22:24.677054 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.680798 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.682616 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.812093 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO dbcounter [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Registered counter for database nova_cell0 Sep 01 16:22:24.819282 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG oslo_db.sqlalchemy.engines [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.823975 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writer thread running {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.824259 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:24.833112 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO dbcounter [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Registered counter for database nova_cell0 Sep 01 16:22:24.842740 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_db.sqlalchemy.engines [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:22:24.847722 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writer thread running {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:22:25.167885 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:22:25.172093 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: WARNING keystonemiddleware.auth_token [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:22:25.175170 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:22:25.179638 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: WARNING keystonemiddleware.auth_token [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:22:25.518752 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:22:25.523077 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: WARNING keystonemiddleware.auth_token [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:22:25.525152 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: WARNING keystonemiddleware.auth_token [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:22:25.529000 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: WARNING keystonemiddleware.auth_token [None req-86bb78ef-281d-424d-8f6d-eb73290ecad6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:22:25.530405 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555820aca9c0 pid: 105500 (default app) Sep 01 16:22:25.532455 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:22:25.533637 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Sep 01 16:22:25.534355 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu Sep 1 16:22:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:22:25.534633 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555820aca9c0 pid: 105499 (default app) Sep 01 16:23:44.048321 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:44.049923 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Sep 01 16:23:44.051057 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:23:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:23:44.068104 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_api:SELECT=3 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:44.069807 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_cell1:SELECT=3 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:44.070663 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_cell0:SELECT=3 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:44.071708 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:44.944168 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-e7e0083e-6815-46c2-989f-68587250d493 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:44.977755 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-e7e0083e-6815-46c2-989f-68587250d493 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919569 Sep 01 16:23:44.978659 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Sep 1 16:23:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:23:47.337861 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:47.338928 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-66870484-ef00-4f47-b5a2-9444f4a0d939 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 01 16:23:47.339530 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:23:47.755920 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-9cc54f31-c15b-42fb-b555-d80e77310ab0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256", "disk": 1}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:47.821018 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-9cc54f31-c15b-42fb-b555-d80e77310ab0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475588 Sep 01 16:23:47.821501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:23:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:23:47.836202 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:47.837351 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell0:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:47.838552 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell1:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:47.839431 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell0:SELECT=3 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:23:48.046489 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-40f18ff0-f3a1-48c6-9a9b-29b3bff766a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:48.118738 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-40f18ff0-f3a1-48c6-9a9b-29b3bff766a1 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288349 Sep 01 16:23:48.119321 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Sep 1 16:23:47 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:23:50.521854 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-9cc54f31-c15b-42fb-b555-d80e77310ab0 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:50.523162 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-9cc54f31-c15b-42fb-b555-d80e77310ab0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002593 Sep 01 16:23:50.523995 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:23:51.212146 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-41460b5e-32b0-4b37-96ed-ecc48d774559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:51.252749 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-41460b5e-32b0-4b37-96ed-ecc48d774559 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.721205 Sep 01 16:23:51.258326 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:23:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:51.266465 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-83c02cbe-13b7-49ce-8c80-2dd4c4dbffa6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:51.305615 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-83c02cbe-13b7-49ce-8c80-2dd4c4dbffa6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043444 Sep 01 16:23:51.314798 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Sep 1 16:23:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:23:53.669848 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-41460b5e-32b0-4b37-96ed-ecc48d774559 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:53.671175 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-41460b5e-32b0-4b37-96ed-ecc48d774559 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Sep 01 16:23:53.671606 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:23:54.078978 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-3575a650-9b34-4a68-8f94-6e941608acbf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:54.097255 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-3575a650-9b34-4a68-8f94-6e941608acbf admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419573 Sep 01 16:23:54.097796 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:23:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:54.109608 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9e322cdc-ff6b-4325-9663-138c4c63ed61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:54.133342 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9e322cdc-ff6b-4325-9663-138c4c63ed61 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027362 Sep 01 16:23:54.133908 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Sep 1 16:23:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:23:56.488087 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-3575a650-9b34-4a68-8f94-6e941608acbf admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:56.489107 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-3575a650-9b34-4a68-8f94-6e941608acbf admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 01 16:23:56.489524 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:23:56.942515 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-eff83786-bb53-443a-b442-c352ae02f995 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "disk": 10, "swap": 0}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:56.962330 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-eff83786-bb53-443a-b442-c352ae02f995 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.465889 Sep 01 16:23:56.963106 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:23:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:56.975250 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-87717e8e-6f4d-4c91-93a2-fe650ea3a83a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:56.999381 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-87717e8e-6f4d-4c91-93a2-fe650ea3a83a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027897 Sep 01 16:23:57.000161 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Sep 1 16:23:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:23:59.348294 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-eff83786-bb53-443a-b442-c352ae02f995 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:23:59.349265 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-eff83786-bb53-443a-b442-c352ae02f995 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Sep 01 16:23:59.349701 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:23:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:23:59.820123 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-2df53129-79bc-4376-aac4-03fb5f14c8c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:59.840870 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-2df53129-79bc-4376-aac4-03fb5f14c8c0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483877 Sep 01 16:23:59.842283 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:23:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:23:59.855421 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-d76bed8f-bb2b-4d3d-87bc-03c3a66297d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:23:59.880828 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-d76bed8f-bb2b-4d3d-87bc-03c3a66297d5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030398 Sep 01 16:23:59.881551 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Thu Sep 1 16:23:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:24:02.291850 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-2df53129-79bc-4376-aac4-03fb5f14c8c0 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:02.293161 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-2df53129-79bc-4376-aac4-03fb5f14c8c0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001919 Sep 01 16:24:02.293697 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:02.741622 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-d3e7820b-d822-4392-bce7-5b3130c855d2 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:02.772760 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-d3e7820b-d822-4392-bce7-5b3130c855d2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471086 Sep 01 16:24:02.773490 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Sep 1 16:24:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:05.244250 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-2df53129-79bc-4376-aac4-03fb5f14c8c0 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:05.245262 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-2df53129-79bc-4376-aac4-03fb5f14c8c0 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 01 16:24:05.245660 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:05.690804 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-23d7debb-01ba-4e25-8464-35707fffe2b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:05.710109 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-23d7debb-01ba-4e25-8464-35707fffe2b4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.456384 Sep 01 16:24:05.710687 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:24:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:05.726443 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1d62fc77-3379-4383-8650-8752729a920e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:05.761857 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1d62fc77-3379-4383-8650-8752729a920e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040036 Sep 01 16:24:05.768780 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Sep 1 16:24:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:24:08.126492 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-23d7debb-01ba-4e25-8464-35707fffe2b4 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:08.127520 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-23d7debb-01ba-4e25-8464-35707fffe2b4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 01 16:24:08.127925 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:08.525536 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-586bd88c-4268-4cde-b3bc-6983b3342682 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:08.544524 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-586bd88c-4268-4cde-b3bc-6983b3342682 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.410390 Sep 01 16:24:08.545073 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:24:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:08.556964 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-67415aea-c5ac-47b2-b8da-de0dcec6d07e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:08.580631 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-67415aea-c5ac-47b2-b8da-de0dcec6d07e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027365 Sep 01 16:24:08.581181 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Sep 1 16:24:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:24:10.945792 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-586bd88c-4268-4cde-b3bc-6983b3342682 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:10.946866 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-586bd88c-4268-4cde-b3bc-6983b3342682 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Sep 01 16:24:10.951986 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:11.349342 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-74138b5c-8c35-40de-a865-f9f4b9c1034d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "vcpus": 2, "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:11.368979 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-74138b5c-8c35-40de-a865-f9f4b9c1034d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.415468 Sep 01 16:24:11.369644 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:24:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:24:11.381665 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-fdd7b238-74a3-403b-b154-af86bf0a30e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:11.407602 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-fdd7b238-74a3-403b-b154-af86bf0a30e3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029462 Sep 01 16:24:11.408186 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Sep 1 16:24:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:24:13.780282 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-74138b5c-8c35-40de-a865-f9f4b9c1034d admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:13.781297 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-74138b5c-8c35-40de-a865-f9f4b9c1034d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 01 16:24:13.787425 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:14.256298 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-7aa4ab4f-9e92-4546-b89a-a6be40530a33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "rxtx_factor": 1.0}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:14.276525 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:14.290248 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-7aa4ab4f-9e92-4546-b89a-a6be40530a33 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501009 Sep 01 16:24:14.291039 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:24:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:24:14.304762 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-8629432d-625e-4ad8-bdc7-bcd8b0c00f7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:14.329889 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-8629432d-625e-4ad8-bdc7-bcd8b0c00f7a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030309 Sep 01 16:24:14.330490 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Sep 1 16:24:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:24:16.745018 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-7aa4ab4f-9e92-4546-b89a-a6be40530a33 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:16.747444 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-7aa4ab4f-9e92-4546-b89a-a6be40530a33 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002851 Sep 01 16:24:16.747841 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:17.194838 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-4c6acb95-767b-4b4f-bd5f-98f9430afe2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "id": "5", "ram": 16384, "disk": 160, "rxtx_factor": 1.0}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:17.215469 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-4c6acb95-767b-4b4f-bd5f-98f9430afe2e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.460744 Sep 01 16:24:17.218279 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Thu Sep 1 16:24:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:17.228200 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-a4588c32-c018-4db3-9fd7-4a8a251deeb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:17.257344 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-a4588c32-c018-4db3-9fd7-4a8a251deeb8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032831 Sep 01 16:24:17.258219 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Thu Sep 1 16:24:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:24:36.227310 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-4c6acb95-767b-4b4f-bd5f-98f9430afe2e admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:36.228233 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-4c6acb95-767b-4b4f-bd5f-98f9430afe2e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 01 16:24:36.228636 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:36.239823 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:36.628752 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-dc92be1e-3d3d-4052-8903-dc1386aedaef admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:36.648432 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-dc92be1e-3d3d-4052-8903-dc1386aedaef admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.413025 Sep 01 16:24:36.648973 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Sep 1 16:24:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:37.697224 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-4c6acb95-767b-4b4f-bd5f-98f9430afe2e admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:37.698262 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-4c6acb95-767b-4b4f-bd5f-98f9430afe2e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 01 16:24:37.699233 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:38.219724 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-e670b5b4-db26-4b56-aa1b-de0d133a4109 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:38.225281 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.wsgi [None req-e670b5b4-db26-4b56-aa1b-de0d133a4109 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-e670b5b4-db26-4b56-aa1b-de0d133a4109 admin admin] Request method failure captured: Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Accept: application/json Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Accept-Encoding: gzip, deflate Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Connection: keep-alive Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Content-Length: 0 Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Host: 10.222.0.58 Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Openstack-Api-Version: compute 2.90 Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Openstack-System-Scope: None Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: User-Agent: python-novaclient Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Auth-Token: gAAAAABjENzF-2HJOgKogJDTY6uNyEfXiMwurl5HRKB2vMsL0sLLX2ZaurSa08oKFz9iflGpnQ4I5eOOVm5ABfoY2md39vOpqfsP-UPPQ6IOuGS-WsKEHiYVtqMTWMVL41243r_Z6FdYvfk8J1l2Wsix7vuyYnpt-0jnkFpO8Q5baWWn9r3wi4A Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Domain-Id: None Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Domain-Name: None Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Identity-Status: Confirmed Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Is-Admin-Project: True Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Domain-Id: default Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Domain-Name: Default Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Name: admin Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Role: admin,reader,member Sep 01 16:24:38.228492 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Roles: admin,reader,member Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2c38221adde4053b2b37201b4051903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2c38221adde4053b2b37201b4051903", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}] Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant: admin Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant-Name: admin Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User: admin Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Domain-Id: default Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Domain-Name: Default Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Id: 9fe3a5506b35415a9373071c0b976e34 Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Name: admin Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: method: > Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: exception: Flavor 42 could not be found. Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: action_args: {'id': '42'} Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:24:38.230074 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:38.231094 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.232571 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-e670b5b4-db26-4b56-aa1b-de0d133a4109 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:24:38.233917 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-e670b5b4-db26-4b56-aa1b-de0d133a4109 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394138 Sep 01 16:24:38.233917 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Sep 1 16:24:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:38.239598 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-f907124e-8258-4de4-a9bd-6dc43b23fcbb admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:38.243829 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:24:38.264946 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-f907124e-8258-4de4-a9bd-6dc43b23fcbb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028874 Sep 01 16:24:38.265511 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Sep 1 16:24:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:38.275385 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-feb01820-1993-44a9-8f97-d170a52760fd admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:38.297823 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-feb01820-1993-44a9-8f97-d170a52760fd admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025954 Sep 01 16:24:38.298398 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Sep 1 16:24:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:38.309112 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-161d687b-6696-45d6-b569-f92a84b6a7ce admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:38.315059 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.wsgi [None req-161d687b-6696-45d6-b569-f92a84b6a7ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-161d687b-6696-45d6-b569-f92a84b6a7ce admin admin] Request method failure captured: Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Accept: application/json Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Accept-Encoding: gzip, deflate Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Connection: keep-alive Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Content-Length: 0 Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Host: 10.222.0.58 Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Openstack-Api-Version: compute 2.90 Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Openstack-System-Scope: None Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: User-Agent: python-novaclient Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Auth-Token: gAAAAABjENzF-2HJOgKogJDTY6uNyEfXiMwurl5HRKB2vMsL0sLLX2ZaurSa08oKFz9iflGpnQ4I5eOOVm5ABfoY2md39vOpqfsP-UPPQ6IOuGS-WsKEHiYVtqMTWMVL41243r_Z6FdYvfk8J1l2Wsix7vuyYnpt-0jnkFpO8Q5baWWn9r3wi4A Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Domain-Id: None Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Domain-Name: None Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Identity-Status: Confirmed Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Is-Admin-Project: True Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Domain-Id: default Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Domain-Name: Default Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Name: admin Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Role: admin,reader,member Sep 01 16:24:38.318391 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Roles: admin,reader,member Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2c38221adde4053b2b37201b4051903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2c38221adde4053b2b37201b4051903", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}] Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant: admin Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant-Name: admin Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User: admin Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Domain-Id: default Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Domain-Name: Default Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Id: 9fe3a5506b35415a9373071c0b976e34 Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Name: admin Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: method: > Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: exception: Flavor 42 could not be found. Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: action_args: {'id': '42'} Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:24:38.319971 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:38.321111 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:38.322435 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-161d687b-6696-45d6-b569-f92a84b6a7ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:24:38.324335 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-161d687b-6696-45d6-b569-f92a84b6a7ce admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015482 Sep 01 16:24:38.324335 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Sep 1 16:24:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:39.306480 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-feb01820-1993-44a9-8f97-d170a52760fd admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:39.307561 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-feb01820-1993-44a9-8f97-d170a52760fd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001827 Sep 01 16:24:39.307987 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:39.830681 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-2b26d24e-2a8e-4cde-8772-bc92af324658 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:39.835957 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.wsgi [None req-2b26d24e-2a8e-4cde-8772-bc92af324658 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-2b26d24e-2a8e-4cde-8772-bc92af324658 admin admin] Request method failure captured: Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Accept: application/json Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Accept-Encoding: gzip, deflate Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Connection: keep-alive Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Content-Length: 0 Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Host: 10.222.0.58 Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Openstack-Api-Version: compute 2.90 Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Openstack-System-Scope: None Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: User-Agent: python-novaclient Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Auth-Token: gAAAAABjENzHM3uFlY9UTafxaj62iETO954yjC8j01GW0zvixOhM3Fm4nK5geNlJlzt4o_bS2nQRg2G1d1BJC-Bcv1yzYPvt4YZIi9T5Monu99c1ceEq1Kxsl73NLjWt8gWWbCIrg-PcKlkBFfIsVAghswPVHhC7aH22-iyTLzo4sxsmYVKlo1U Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Domain-Id: None Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Domain-Name: None Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Identity-Status: Confirmed Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Is-Admin-Project: True Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Domain-Id: default Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Domain-Name: Default Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Name: admin Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Role: admin,reader,member Sep 01 16:24:39.837442 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Roles: admin,reader,member Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2c38221adde4053b2b37201b4051903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2c38221adde4053b2b37201b4051903", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}] Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant: admin Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant-Name: admin Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User: admin Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Domain-Id: default Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Domain-Name: Default Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Id: 9fe3a5506b35415a9373071c0b976e34 Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Name: admin Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: method: > Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: exception: Flavor 84 could not be found. Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: action_args: {'id': '84'} Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:24:39.839047 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:39.840474 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.841786 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-2b26d24e-2a8e-4cde-8772-bc92af324658 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:24:39.843162 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-2b26d24e-2a8e-4cde-8772-bc92af324658 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388975 Sep 01 16:24:39.843162 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Sep 1 16:24:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:39.849135 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-c6de2596-f6d9-40ed-a624-ed0e37191a09 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:39.864565 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-c6de2596-f6d9-40ed-a624-ed0e37191a09 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018880 Sep 01 16:24:39.865012 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Sep 1 16:24:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:39.874118 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a7474c00-f473-459d-aeae-c4d8964f5a47 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:39.890113 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a7474c00-f473-459d-aeae-c4d8964f5a47 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019414 Sep 01 16:24:39.890657 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Sep 1 16:24:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:39.899720 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-22f980a0-9e85-4cfa-aa06-995b6f504fb4 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:39.905711 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.wsgi [None req-22f980a0-9e85-4cfa-aa06-995b6f504fb4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-22f980a0-9e85-4cfa-aa06-995b6f504fb4 admin admin] Request method failure captured: Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Accept: application/json Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Accept-Encoding: gzip, deflate Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Connection: keep-alive Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Content-Length: 0 Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Host: 10.222.0.58 Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Openstack-Api-Version: compute 2.90 Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Openstack-System-Scope: None Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: User-Agent: python-novaclient Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Auth-Token: gAAAAABjENzHM3uFlY9UTafxaj62iETO954yjC8j01GW0zvixOhM3Fm4nK5geNlJlzt4o_bS2nQRg2G1d1BJC-Bcv1yzYPvt4YZIi9T5Monu99c1ceEq1Kxsl73NLjWt8gWWbCIrg-PcKlkBFfIsVAghswPVHhC7aH22-iyTLzo4sxsmYVKlo1U Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Domain-Id: None Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Domain-Name: None Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Identity-Status: Confirmed Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Is-Admin-Project: True Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Domain-Id: default Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Domain-Name: Default Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Name: admin Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Role: admin,reader,member Sep 01 16:24:39.907216 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Roles: admin,reader,member Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2c38221adde4053b2b37201b4051903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2c38221adde4053b2b37201b4051903", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}] Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant: admin Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant-Name: admin Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User: admin Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Domain-Id: default Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Domain-Name: Default Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Id: 9fe3a5506b35415a9373071c0b976e34 Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Name: admin Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: method: > Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: exception: Flavor 84 could not be found. Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: action_args: {'id': '84'} Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:24:39.908945 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:39.909959 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:39.911501 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-22f980a0-9e85-4cfa-aa06-995b6f504fb4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:24:39.912944 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-22f980a0-9e85-4cfa-aa06-995b6f504fb4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012285 Sep 01 16:24:39.912944 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Sep 1 16:24:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:40.883067 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a7474c00-f473-459d-aeae-c4d8964f5a47 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:40.884082 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a7474c00-f473-459d-aeae-c4d8964f5a47 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 16:24:40.884529 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:41.405019 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-7e2565e4-cce0-4c6c-b104-eb4397f21496 admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:41.410846 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.wsgi [None req-7e2565e4-cce0-4c6c-b104-eb4397f21496 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-7e2565e4-cce0-4c6c-b104-eb4397f21496 admin admin] Request method failure captured: Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Accept: application/json Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Accept-Encoding: gzip, deflate Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Connection: keep-alive Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Content-Length: 0 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Host: 10.222.0.58 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Openstack-Api-Version: compute 2.90 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Openstack-System-Scope: None Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: User-Agent: python-novaclient Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Auth-Token: gAAAAABjENzIX6ccw1yzCHq0Q9Zgk6PXROdO5hD9btIuPRi3gBf5bcEcHV5yxpptDhtjz1d8louNFrUGqk0490Ma-62yvCWIMhYOBZ98E15N7ML6QKFQDBcy6iAw3UeDoqbIN1XyABHYoFcbW41jtICwJMbW5ed-FdxXqE06mzawX-gckqg04i8 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Domain-Id: None Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Domain-Name: None Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Identity-Status: Confirmed Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Is-Admin-Project: True Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Domain-Id: default Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Domain-Name: Default Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Project-Name: admin Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Role: admin,reader,member Sep 01 16:24:41.412430 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Roles: admin,reader,member Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2c38221adde4053b2b37201b4051903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2c38221adde4053b2b37201b4051903", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}] Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant: admin Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-Tenant-Name: admin Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User: admin Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Domain-Id: default Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Domain-Name: Default Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Id: 9fe3a5506b35415a9373071c0b976e34 Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: X-User-Name: admin Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: method: > Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: exception: Flavor 451 could not be found. Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: action_args: {'id': '451'} Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:24:41.413749 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:41.414604 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.415979 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-7e2565e4-cce0-4c6c-b104-eb4397f21496 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:24:41.417272 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-7e2565e4-cce0-4c6c-b104-eb4397f21496 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392118 Sep 01 16:24:41.417272 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Sep 1 16:24:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:41.423989 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-d31cbe49-a9bb-4f36-9bcf-82399a2a8f97 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:41.439249 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-d31cbe49-a9bb-4f36-9bcf-82399a2a8f97 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018848 Sep 01 16:24:41.439785 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Sep 1 16:24:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:41.449113 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:41.464790 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018698 Sep 01 16:24:41.465304 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Sep 1 16:24:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:24:41.474423 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9a2ad649-47e9-4086-881f-e1662e91e182 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:41.479709 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.wsgi [None req-9a2ad649-47e9-4086-881f-e1662e91e182 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9a2ad649-47e9-4086-881f-e1662e91e182 admin admin] Request method failure captured: Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Accept: application/json Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Accept-Encoding: gzip, deflate Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Connection: keep-alive Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Content-Length: 0 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Host: 10.222.0.58 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Openstack-Api-Version: compute 2.90 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Openstack-System-Scope: None Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: User-Agent: python-novaclient Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Auth-Token: gAAAAABjENzIX6ccw1yzCHq0Q9Zgk6PXROdO5hD9btIuPRi3gBf5bcEcHV5yxpptDhtjz1d8louNFrUGqk0490Ma-62yvCWIMhYOBZ98E15N7ML6QKFQDBcy6iAw3UeDoqbIN1XyABHYoFcbW41jtICwJMbW5ed-FdxXqE06mzawX-gckqg04i8 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Domain-Id: None Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Domain-Name: None Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Identity-Status: Confirmed Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Is-Admin-Project: True Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Domain-Id: default Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Domain-Name: Default Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Project-Name: admin Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Role: admin,reader,member Sep 01 16:24:41.481835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Roles: admin,reader,member Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e2c38221adde4053b2b37201b4051903"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e2c38221adde4053b2b37201b4051903", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e2c38221adde4053b2b37201b4051903"}]}] Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant: admin Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant-Id: e2c38221adde4053b2b37201b4051903 Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-Tenant-Name: admin Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User: admin Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Domain-Id: default Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Domain-Name: Default Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Id: 9fe3a5506b35415a9373071c0b976e34 Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: X-User-Name: admin Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: method: > Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: exception: Flavor 451 could not be found. Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: action_args: {'id': '451'} Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:24:41.483459 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:41.484277 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: ERROR nova.api.openstack.wsgi Sep 01 16:24:41.485477 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-9a2ad649-47e9-4086-881f-e1662e91e182 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105500) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:24:41.486791 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-9a2ad649-47e9-4086-881f-e1662e91e182 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012319 Sep 01 16:24:41.486791 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Sep 1 16:24:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 16:24:42.439709 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:42.440723 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 01 16:24:42.441116 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:42.972869 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-7f29f20f-9999-4d54-ae66-3c45e4a17a4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:42.991584 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-7f29f20f-9999-4d54-ae66-3c45e4a17a4b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.410510 Sep 01 16:24:42.992116 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Sep 1 16:24:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:43.966215 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:43.967230 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 01 16:24:43.967625 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:44.492589 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-767c5b4d-8fb9-47e0-85b2-c6cb8a19fff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:44.511415 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-767c5b4d-8fb9-47e0-85b2-c6cb8a19fff6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408224 Sep 01 16:24:44.511956 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Sep 1 16:24:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:45.493202 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:45.494233 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 01 16:24:45.494661 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:46.019289 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-fd83e865-904e-466d-8716-3e157c5e5378 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:46.037862 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-fd83e865-904e-466d-8716-3e157c5e5378 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.399721 Sep 01 16:24:46.038425 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Sep 1 16:24:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:24:47.013595 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:47.014652 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 01 16:24:47.015054 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:47.536254 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-763fe2d9-d755-4cbe-a601-6e903f213ee0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:24:47.554301 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-763fe2d9-d755-4cbe-a601-6e903f213ee0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400465 Sep 01 16:24:47.554835 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Sep 1 16:24:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:24:48.533845 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:48.534901 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 01 16:24:48.535292 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:24:49.052704 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a6db15bf-cb7f-47ff-9755-6c661de62680 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:24:49.073033 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a6db15bf-cb7f-47ff-9755-6c661de62680 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400494 Sep 01 16:24:49.073573 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu Sep 1 16:24:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:25:42.379720 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:42.380661 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-1aa18d5f-4aab-487c-892b-5b8673c5da6a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 01 16:25:42.381090 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Thu Sep 1 16:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:25:42.392052 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.764005 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-48489cb2-179b-49e7-9aa4-f4f0b49a6cf6 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:42.784427 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-48489cb2-179b-49e7-9aa4-f4f0b49a6cf6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397283 Sep 01 16:25:42.784948 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Thu Sep 1 16:25:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:25:42.806545 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG dbcounter [-] [105499] Writing DB stats nova_api:SELECT=14 {{(pid=105499) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:25:42.810724 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-b380ca9a-c2d3-4820-a2da-e192b72e530e admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:42.818595 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-b380ca9a-c2d3-4820-a2da-e192b72e530e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013478 Sep 01 16:25:42.819116 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Thu Sep 1 16:25:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:42.830405 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a2e48aa5-5c53-42ef-baa1-bf3df8e2f7c0 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:42.837870 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a2e48aa5-5c53-42ef-baa1-bf3df8e2f7c0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010952 Sep 01 16:25:42.838420 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Thu Sep 1 16:25:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:42.850230 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:42.858258 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011442 Sep 01 16:25:42.858762 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Thu Sep 1 16:25:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:25:42.869859 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-61b810c3-3b7f-460a-8e1b-2b98114ba77c admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:25:42.877679 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-61b810c3-3b7f-460a-8e1b-2b98114ba77c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011222 Sep 01 16:25:42.878185 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Thu Sep 1 16:25:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:28:42.640156 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:42.641198 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Sep 01 16:28:42.641586 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:28:42.782671 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=6 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:42.947417 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:42.951043 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:42.951519 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:42.951941 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:42.952641 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:42.953082 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:42.953495 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:42.989069 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-c091d09d-0af8-44a9-9f84-d448fde29e96 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.207871 Sep 01 16:28:42.989622 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Sep 1 16:28:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:43.835429 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:43.836431 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Sep 01 16:28:43.836824 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:28:44.024838 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:44.029246 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:44.029892 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:44.030360 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:44.031071 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:44.031515 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:44.032018 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:44.054860 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-ac728eeb-6d80-4fe5-900e-51301a643b67 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080726 Sep 01 16:28:44.055424 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Sep 1 16:28:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:28:55.266487 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:55.267497 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 01 16:28:55.268467 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:28:55.411850 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell0:SELECT=4 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:55.412827 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_cell1:SELECT=4 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:55.413526 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG dbcounter [-] [105500] Writing DB stats nova_api:SELECT=8 {{(pid=105500) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:28:55.460642 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:55.464051 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:55.464521 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:55.464948 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:55.465653 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:55.466099 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:55.466536 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:55.491094 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-a2db4d6c-8ff4-42ea-825a-a537fd76e55c admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083574 Sep 01 16:28:55.491655 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Sep 1 16:28:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:28:56.459874 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: DEBUG nova.api.openstack.wsgi [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] Calling method '>' {{(pid=105499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:56.460911 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: INFO nova.api.openstack.requestlog [None req-b14cf707-543a-4e0e-981f-4e4dd3e97ecb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 01 16:28:56.461309 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: [pid: 105499|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Sep 1 16:28:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:28:56.657495 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG nova.api.openstack.wsgi [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Calling method '>' {{(pid=105500) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:28:56.661405 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:56.661882 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:56.662606 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:56.663320 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:28:56.663768 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:28:56.664186 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: DEBUG oslo_concurrency.lockutils [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105500) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:28:56.685525 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: INFO nova.api.openstack.requestlog [None req-19c9c11f-b599-4fb9-b7af-6fd6c922326d admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080421 Sep 01 16:28:56.686075 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: [pid: 105500|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Sep 1 16:28:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:29:56.806878 dv-cinder-852208-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 16:29:56.807428 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: Thu Sep 1 16:29:56 2022 - graceful shutdown triggered... Sep 01 16:29:56.807900 dv-cinder-852208-16-iscsi devstack@n-api.service[105499]: Gracefully killing worker 1 (pid: 105499)... Sep 01 16:29:56.808276 dv-cinder-852208-16-iscsi devstack@n-api.service[105500]: Gracefully killing worker 2 (pid: 105500)... Sep 01 16:29:57.808036 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: worker 1 buried after 1 seconds Sep 01 16:29:57.808036 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: worker 2 buried after 1 seconds Sep 01 16:29:57.808036 dv-cinder-852208-16-iscsi devstack@n-api.service[105498]: goodbye to uWSGI. Sep 01 16:29:57.809540 dv-cinder-852208-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 16:29:57.810077 dv-cinder-852208-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 16:29:57.812930 dv-cinder-852208-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 16:29:57.823578 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 16:29:57 2022] *** Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: nodename: dv-cinder-852208-16-iscsi Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: machine: x86_64 Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: clock source: unix Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: pcre jit disabled Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: detected number of CPU cores: 4 Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: current working directory: / Sep 01 16:29:57.825619 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: detected binary path: /usr/bin/uwsgi-core Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: your processes number limit is 47680 Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: your memory page size is 4096 bytes Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: detected max file descriptor number: 2048 Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: lock engine: pthread robust mutexes Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: thunder lock: enabled Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 16:29:57.826438 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 16:29:57.866947 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: Python main interpreter initialized at 0x5636dcd129c0 Sep 01 16:29:57.866947 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: python threads support enabled Sep 01 16:29:57.866947 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: your server socket listen backlog is limited to 100 connections Sep 01 16:29:57.866947 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: your mercy for graceful operations on workers is 90 seconds Sep 01 16:29:57.867370 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 16:29:57.867449 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: *** Operational MODE: preforking *** Sep 01 16:29:57.867894 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: *** uWSGI is running in multiple interpreter mode *** Sep 01 16:29:57.867894 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: spawned uWSGI master process (pid: 120673) Sep 01 16:29:57.868101 dv-cinder-852208-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 16:29:57.868963 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: spawned uWSGI worker 1 (pid: 120692, cores: 1) Sep 01 16:29:57.869100 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: spawned uWSGI worker 2 (pid: 120693, cores: 1) Sep 01 16:29:57.869238 dv-cinder-852208-16-iscsi devstack@n-api.service[120673]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 16:29:58.526119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:29:58.577700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 16:29:59.674904 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:29:59.674904 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: from cryptography.utils import int_from_bytes Sep 01 16:29:59.675567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:29:59.675567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: from cryptography.utils import int_from_bytes Sep 01 16:29:59.749608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:29:59.749608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: from cryptography.utils import int_from_bytes Sep 01 16:29:59.750220 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 16:29:59.750220 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: from cryptography.utils import int_from_bytes Sep 01 16:30:02.054074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:30:02.054551 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:30:02.054883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:30:02.055249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:30:02.055506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:30:02.055897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.056227 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.056552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.056892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.057202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.057515 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.057836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.058157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.058509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.058774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.059097 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.059422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-16-iscsi {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.059894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.062934 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.063818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.066829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.067063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-16-iscsi {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.067557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.068026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.068505 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.069068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.069544 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.070010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.070521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.070998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.071561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.072066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.072543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.073017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.073508 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.073987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.074327 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.074815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.075147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.075462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.075775 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.076030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.076343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.076674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.077002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.077328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.077583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.077835 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.078158 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.078539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.078852 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.079169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.079478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.079785 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.080094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.080399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.080707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.081013 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.081333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.081648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.081972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.082351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.082677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.083079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.083332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.083644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.083986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.084308 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.084619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.084939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.085259 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.085570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.085880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.086209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.086552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.086892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.087240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.087453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.087758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.088068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.088390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.088700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.089017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.089327 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.089631 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.089941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.090287 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.090600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.090909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.091217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.091525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.091832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.092137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.092453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.092764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.093086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.093410 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.093853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.094030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.095174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.095351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.095529 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.095841 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.096153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.096483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.096799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.097106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.097870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.097870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.098186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.098463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.098760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.099075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.099438 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.099733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.100031 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.100339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.100649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.100956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.101266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.101572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.101879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.102183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.102585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.102905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.103169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.103480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.103800 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.104176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.104452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.104786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.105136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.105557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.105781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.106120 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.106493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.106812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.107131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.107462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.107778 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.108093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.108408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.108732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.109658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.109658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.110671 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.110671 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.110963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.111571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.111571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.111897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.112174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.112492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.112840 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.113196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.113516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.113846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.114174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.114535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.114852 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.115166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.115521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.115837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.116165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.116477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.116794 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.117125 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.117441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.117756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.118074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.118422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.118739 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.119088 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.119408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.119743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.120063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.120380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.120703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.121020 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.121335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.121648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.121956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.122295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.122605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.122921 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.123229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.123556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.123891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.124205 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.124547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.124851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.125370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.125840 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.126351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.126832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.127320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.127801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.128264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.128753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.129243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.129723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.130238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.130699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.131180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.131708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.132249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.132673 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.132919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.133258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.133633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.133925 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.134272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.134626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.134971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.135285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.135610 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.136138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.136469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.136778 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.137119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.137456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.137755 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.138057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.138401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.138707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.139220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.139805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.140319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.140814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.141474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.142105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.142517 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.142905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.143289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.143769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.144087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.144447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.144799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.145127 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.145461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.145781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.146145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.146518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.146836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.147153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.147472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.147805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.148137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.148439 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.148750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.149083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.149393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.149727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.150034 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.150399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.150751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.151093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.151418 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.151747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.152065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.152388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.152702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.153021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.153335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.153649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.153973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.154323 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.154672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.154970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.155298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.155615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.155937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.156245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.157116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.157440 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.157790 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.158090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.158645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.158979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.159292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.159606 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.159921 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.160236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.160543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.160861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.161181 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.161494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.161809 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.162114 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.162714 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.163037 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.163338 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.163649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.163964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.164298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.164613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.164938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.165265 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.165573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.165885 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.166245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.166587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.166870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.167180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.167488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.167840 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.168185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.168519 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.168798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.169165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.169407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.169727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.170049 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.170389 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.170715 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.171033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.171354 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.171658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.171974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.172362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.173179 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.173513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.173824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.174136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.174481 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.174791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.175273 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.175600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.176196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.176534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.176855 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.177181 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.177532 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.177855 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.178321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.178694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.178898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.179161 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.179478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.179765 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.180078 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.180393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.180701 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.181008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.181313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.181629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.181934 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.182307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.182568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.182874 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.183192 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.183497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.183811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.184116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.184440 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.184751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.185057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.185361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.185709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.186103 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.186352 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.186694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.187025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.187370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.187678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.188037 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.188404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.188714 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.188977 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.189285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.189612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.189901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.190225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.190541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.190851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.191162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.191474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.191777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.192087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.192322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 16:30:02.192839 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.192987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 16:30:02.193131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.193131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.193420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 16:30:02.193563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.193706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 16:30:02.193938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.194102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 16:30:02.194277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.194277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.194565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.194727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.194987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.195314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.195654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.195828 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.196046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.196210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.196430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.196593 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.197322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.197487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.197641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.197791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.197959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.198104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.198297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.198508 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.198666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852208-16-iscsi {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.198906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.199259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.199492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.199651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.199933 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.200087 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.200231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.200397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.200561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.200705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.200847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.200998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.201142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.201298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.201450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.201450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.201730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.202005 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.202169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.202372 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.202607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.202755 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.202899 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.203073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.203227 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.203379 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.203554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.203708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.203859 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.204104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.204262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.204415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.204575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.204731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.204881 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.205034 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.205177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.205329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.205329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.205615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852208-16-iscsi {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.205767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.205910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.206081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.206317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.206558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.206707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.206867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.207011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.207162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.207305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.207448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.207605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.207783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.207938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.208082 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.208224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.208366 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.208572 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.208723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.208883 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.209100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.209324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.209491 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.209710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.209897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.210144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.210341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.210494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.210654 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.210818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.210980 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.211129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.211277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.211433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.211598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.211757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.211913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.212160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.212315 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.212464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.212644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.212873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.213026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.213186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.213344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.213494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.213659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.213809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.213969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.214139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.214139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.214589 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.214749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.214900 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.215073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.215270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.215426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.215595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.215746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.215895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.216043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.216191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.216367 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.216616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.216843 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.217000 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.217149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.217309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.217468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.217625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.217774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.217932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.218089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.218267 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.218437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.218587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.218788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.218939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.219820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.219980 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.220180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.220428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.220619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.220771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.220921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.221079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.221246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.221397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.221547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.221704 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.221855 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.222014 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.222622 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.222792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.223056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.223328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.223493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.223654 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.223856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.224021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.224181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.224181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.224577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.224747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.224747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.225211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.225369 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.225369 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.225662 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.225831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.225989 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.226138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.226138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.226468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.226729 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.226979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.227142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.227293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.227463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.227619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.227783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.227940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.228089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.228246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.228424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.228673 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.228882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.229040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.229190 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.229338 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.229495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.229656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.230062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.230251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.230418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.230569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.230815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.230979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.231138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.231434 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.231595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.231753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.231910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.232155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.232349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.232505 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.232745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.232981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.233217 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.233420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.233578 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.233727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.233889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.233889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.234260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.234456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.234758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.235403 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.235551 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.235684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.235820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.235957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.236095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.236224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.236368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.236531 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.236670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.236884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.237117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.237264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.237402 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.237532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.237661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.237798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.237928 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.238064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.238265 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.238397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.238533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.238698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.238875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.239020 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.239197 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.239326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.239326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.239579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.239708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.240071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.240218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.240390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.240520 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.240688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.241066 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.241238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.241238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.241492 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.241622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.241622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.241882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.242032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.242172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.242408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.242408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.242660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.242824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.242969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.243177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.243177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.243540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.243669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.243669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.243926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 16:30:02.244056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.244183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.244317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.244317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.244604 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.244753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.244753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245358 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.245930 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.247642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.247806 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.247806 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.248094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.248249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.248249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.248542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.248730 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.248923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.249074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.249074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.249373 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.249525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.249525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.249842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.250015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.250441 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.250596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.250596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.250927 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.251095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.251349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.251507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.251658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.251881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.252074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.252241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.252395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.252540 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.252692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.252868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.253027 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.253189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.253458 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.253695 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.253844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.253987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.254130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.254363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.254363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.254654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.254805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.255109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.255268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.255512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.255683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.255868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256775 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.256966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.257198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.257354 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.257519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.257759 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.257907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.258300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.258462 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.258616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.258762 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.258904 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.259099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.259256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.259408 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.259605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.259759 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.259946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.260980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.261144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.261290 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.262247 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.262403 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.262547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.262689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.262831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.262974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.263130 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.263282 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.263444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.263720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.263972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.264134 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.264286 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.264430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.264572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.264721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.264875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.265077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.265303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.265457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.265601 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.265750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.265902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.266597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.266743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.266887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.267029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.267223 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.267452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.267610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.267610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.267921 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268226 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268396 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.268975 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269668 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.269819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.270253 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.270414 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.270568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.270720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.271082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.271241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.271394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.271394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.271787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.271932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272531 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272825 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.272967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.273155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.273304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.273450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.273592 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.274550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.274720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.274879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.275025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.275229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.275463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.275616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.275769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.275921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276816 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.276966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.277109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.277270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.277430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.277728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.277886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.278967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.279111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.279264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.279421 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.279572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.279716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.279858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280306 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280617 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.280901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.281430 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.281643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.282495 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.282658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.282804 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.282959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.283118 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.283305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.283454 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.283597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.283748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.283900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.284062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.284290 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.284447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.284772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.284925 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.285085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.285229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.285372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.285613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.285771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.285924 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.286069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.286230 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.286392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.286547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.286698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.286860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.287009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.287399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.287555 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.287788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.287947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.288100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.288251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.288251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.288523 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.288725 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.288869 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289019 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289171 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.289975 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.290116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.290279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.290425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.290588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.290751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.290895 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.291044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.291226 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.291412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.291566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.291868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.292879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.293276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.293433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.293584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.293734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.293876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.294017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.294159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.294447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.294606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.294776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.294776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.295149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.295301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.295454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.295616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.295839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.295986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.296137 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.296281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.296432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.296576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.296719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.296872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.297015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.297156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.297377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.297534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.297692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.297920 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298550 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.298995 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.299152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.299296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.299445 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.299588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.299737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.299888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.300967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301267 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301943 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.301943 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.302245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.302245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.302548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.302730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.302982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.303154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.303304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.303453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.303602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.303764 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.303922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.304077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.304235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.304385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.304632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.304797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.304949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.305203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.305359 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.305509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.305676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.305854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.306086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.306277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.306444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.306609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.306760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.306918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.307070 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.307227 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.307401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.307593 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.307751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.307920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.308142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.308304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.308465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.308629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.308786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.308944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.309094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.309244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.309403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.309570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.309720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.309869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.310026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.310176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.310364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.310531 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.310692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.310849 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311635 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.311951 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.312114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.312275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.312424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.312966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.313213 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.313371 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.313571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.313723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.313874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.314045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.314293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.314453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.314644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.314878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.315035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.315203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.315446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.315611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.315762 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.315911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.316095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.316339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.316507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.316668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.316819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.316975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317753 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.317903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.318299 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.318489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.318642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.318803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.318953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.319102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.319258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.319418 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.319571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.319731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.319896 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320213 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320531 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320686 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.320994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.321150 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.321307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.321456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.321605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.321764 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.321914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.322062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.322268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.322436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.322596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.322757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.322916 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.323065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.323242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.323519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.323678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.323678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.323990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.324146 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.324296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.324445 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.324616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.324773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325388 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.325963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.327291 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.327464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.327616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.327765 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.327922 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.328081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.328240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.328990 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.329149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.329299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.329569 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.329742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.329900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.330071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.330264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.330431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.330599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.330764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.330926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.331085 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.331247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.331397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.331546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.331752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.331905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332372 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332680 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.332985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.333141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.333292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.333450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.333624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.333859 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334526 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.334991 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.335222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.335388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.335549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.335700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.335857 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.336007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.336164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.336437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.336684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.336849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.337922 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.338079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.338247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.338420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.338666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.338829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.338980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.339130 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.339362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.339516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.339700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.339861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.340011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.340168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.340332 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.340502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.340672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.340839 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341061 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.341991 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.342148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.342356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.342509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.342666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.342826 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.342983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.343147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.343297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.343454 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.343604 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.343762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.344013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.344013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.344883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345634 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.345955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120693) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.346260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.347802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.349013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.350157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.351359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.352483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.353637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.354916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.356362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.358803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.360874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.361157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.361423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.361935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.362496 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.363244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.363244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.363696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.364089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.364485 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.364821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.365158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.365482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.366000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.366444 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.366787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.367251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.367647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.367986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.368417 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.368752 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.369093 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.369403 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.369736 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.370053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.370394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.370717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.371033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.371347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.371684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.371994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.372362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.372626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.372944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.373257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.373573 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.373906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.374237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.374577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.374898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.375231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.375593 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.375910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.376240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.376559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.376871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.377204 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.377491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.377841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.378153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.378506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.378844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.379201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.379498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.379837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.380172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.380503 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.380828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.381159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.381479 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.381792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.382110 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.382468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.382842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.383114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.384144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.384490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.384817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.385136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.385476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.385795 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.386132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.386496 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.386818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.387137 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.387588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.387944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.388261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.388601 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.388924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.389314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.389695 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.389997 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.390428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.390757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.391606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.391939 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.392271 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.392586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.392908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.393067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO dbcounter [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Registered counter for database nova_api Sep 01 16:30:02.393222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.393545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.394120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.394486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.394819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.395132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.395455 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.395777 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.396102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.396421 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.396741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.397061 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.397534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.397709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.398031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.398392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.398738 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.399067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.399424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.399708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.400030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.400395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.400717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.401034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.401355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.401675 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.402003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.402412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.402733 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.403053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.403372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.403692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.404009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.404328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.404647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.404981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.405322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.405651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.405969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.406314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.407190 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.407782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.408152 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.409376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.409376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.409926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.410161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.410472 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.410790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.411112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.411428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.411754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.412074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.412645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.413102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.413434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.413827 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.414067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.414457 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_db.sqlalchemy.engines [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.414714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.415150 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.415354 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.415662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.416002 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.416390 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.416664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.416983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.417588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.417997 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.418244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.418660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.418890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.419207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.419522 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.419866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.420162 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.420477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.420820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.421069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writer thread running {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.421236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.421425 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.421740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.422059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.422438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.422761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.423077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.423390 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.423740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.424014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.424334 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.424646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.424968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.425308 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.425584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.425893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.426285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.426707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.427038 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.427353 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.427664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.428052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.428305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.428633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.428955 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.429274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.429630 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.429956 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.430553 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.430891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.431219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.431563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.431905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.432218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.432532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.432843 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.433176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.433493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.433809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.434131 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.434477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.434796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.435113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.435431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.435749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.436064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.436382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.436699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.437014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.437329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.437645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.438037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.438363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.438689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.439015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.439338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.439661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.439996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.440292 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.440609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.440936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.441244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.441583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.441906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.442229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.442669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.442992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.443323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.443653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.443970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.444304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.444634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.444954 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.445284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.445605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.445944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.446317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.446654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.446982 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.447288 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.447601 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.448022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.448391 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.448660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.448977 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.449289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.449600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.449917 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.450247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.450561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.450872 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.451233 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.451550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.451863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.452176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.452487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.452799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.453109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.453929 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.454326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.454586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.454911 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.455205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.455513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.455824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.456164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.456508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.456831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.457164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.457483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.457815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.458133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.458525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.458818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.459143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.459464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.459805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.460124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.460443 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.460760 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.461081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.461398 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.461836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.462052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.462438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.462760 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.463094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.463465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.463743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.464065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.464444 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.464715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.465033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.465348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.465668 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.465985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.466326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.466651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.466969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.467285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.467607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.468201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.468387 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.468652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.468894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.469813 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.470081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.470467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.470788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.471139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.471476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.471799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.472123 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.472435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 16:30:02.472682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120692) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 16:30:02.477265 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.context [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),821da9c6-175b-449b-a524-866ff6db58f0(cell1) {{(pid=120693) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:30:02.481241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:02.481721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:02.483899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:02.484123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:02.484516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:02.486576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:02.488560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO dbcounter [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Registered counter for database nova_cell0 Sep 01 16:30:02.492700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO dbcounter [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Registered counter for database nova_cell1 Sep 01 16:30:02.501707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_db.sqlalchemy.engines [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.503493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_db.sqlalchemy.engines [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.509966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writer thread running {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.511859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writer thread running {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.535776 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO dbcounter [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Registered counter for database nova_api Sep 01 16:30:02.557036 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.564222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writer thread running {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.621750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.context [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),821da9c6-175b-449b-a524-866ff6db58f0(cell1) {{(pid=120692) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 16:30:02.625814 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:02.626314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:02.627882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:02.628605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:30:02.629045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:30:02.631237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:30:02.633261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO dbcounter [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Registered counter for database nova_cell0 Sep 01 16:30:02.637722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO dbcounter [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Registered counter for database nova_cell1 Sep 01 16:30:02.646915 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.648343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.657845 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writer thread running {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.658509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writer thread running {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.661436 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO dbcounter [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Registered counter for database nova_cell0 Sep 01 16:30:02.668775 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_db.sqlalchemy.engines [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120693) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.673284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writer thread running {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.814823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO dbcounter [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Registered counter for database nova_cell0 Sep 01 16:30:02.821286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_db.sqlalchemy.engines [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120692) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 16:30:02.825554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writer thread running {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 16:30:02.989373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: WARNING keystonemiddleware.auth_token [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:30:02.996927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: WARNING keystonemiddleware.auth_token [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:30:03.148714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: WARNING keystonemiddleware.auth_token [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:30:03.156045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: WARNING keystonemiddleware.auth_token [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:30:03.346484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: WARNING keystonemiddleware.auth_token [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:30:03.352846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: WARNING keystonemiddleware.auth_token [None req-586cac0f-2707-495a-b8fd-ead689d7f0c2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:30:03.358423 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636dcd129c0 pid: 120693 (default app) Sep 01 16:30:03.506037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: WARNING keystonemiddleware.auth_token [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 16:30:03.512062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: WARNING keystonemiddleware.auth_token [None req-4c0c16ff-2a50-45ab-8288-8a86ffb90ea2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 16:30:03.517878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5636dcd129c0 pid: 120692 (default app) Sep 01 16:30:40.965216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:40.966988 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:40.967972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:40.968699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:42.816602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-850354e8-2519-410e-aea8-cd958a6eff55 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Action: 'create', calling method: .version_select at 0x7f6c9dd3b1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-860946213", "metadata": {"Type": "work"}}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:30:43.689467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-850354e8-2519-410e-aea8-cd958a6eff55 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.742041 Sep 01 16:30:43.690459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Sep 1 16:30:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2745 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 16:30:44.389913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-620adab2-4708-4f9d-98c7-32f9fb942a50 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Calling method '.version_select at 0x7f6c9ddf3310>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:44.462329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:44.463037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:44.463855 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:44.464620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:30:44.844189 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-620adab2-4708-4f9d-98c7-32f9fb942a50 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4" status: 200 len: 353 microversion: 2.1 time: 1.140023 Sep 01 16:30:44.845196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 1/2] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:30:43 2022] GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4 => generated 353 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:44.861323 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bb47b55a-2166-469d-88ff-ef8787b9d963 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Calling method '.version_select at 0x7f6c9dc2b0d0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:45.038164 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bb47b55a-2166-469d-88ff-ef8787b9d963 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4" status: 200 len: 353 microversion: 2.1 time: 0.183417 Sep 01 16:30:45.039554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:30:44 2022] GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4 => generated 353 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:45.059058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-939a7092-10b9-4e3b-8848-a7372741d50b tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Calling method '.version_select at 0x7f6c9dc0e0d0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:45.271948 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-939a7092-10b9-4e3b-8848-a7372741d50b tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4" status: 202 len: 0 microversion: 2.1 time: 0.220761 Sep 01 16:30:45.275344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:30:45 2022] DELETE /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:30:45.281577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-683bfa22-9e02-4dcb-b927-c0680c1ad6d2 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Calling method '.version_select at 0x7f6c9dc2b790>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:45.532099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-683bfa22-9e02-4dcb-b927-c0680c1ad6d2 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4" status: 200 len: 352 microversion: 2.1 time: 0.254874 Sep 01 16:30:45.532964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 3/5] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:30:45 2022] GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4 => generated 352 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:46.578660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6d8af15f-c3ff-4c30-8f55-325afd5be9a9 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Calling method '.version_select at 0x7f6c9dc0e3a0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:46.613119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-6d8af15f-c3ff-4c30-8f55-325afd5be9a9 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] HTTP exception thrown: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6d8af15f-c3ff-4c30-8f55-325afd5be9a9 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Request method failure captured: Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4 HTTP/1.1 Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN4wChfBO0sB_tHvn7wlQFZ6lPAYJw0CjhMzZpYrBcycT1sMJ2Si3igAfbFekFi5kZn2o3Ux9GE-IO_B79XAY1wTDlQjHS5pmUOBkz4-7H62IfLGdXGdMuAgyyiCgljdGyobhgx2r-4Wv6tzmKmG8dxoCkTnkA8MVjXYKCa5TwszhJ0 Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 4daf154c084546dfb637a68b0f708c6b Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesGetTestJSON-250371350 Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:30:46.628797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4daf154c084546dfb637a68b0f708c6b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4daf154c084546dfb637a68b0f708c6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4daf154c084546dfb637a68b0f708c6b", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4daf154c084546dfb637a68b0f708c6b"}]}] Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesGetTestJSON-250371350 Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 4daf154c084546dfb637a68b0f708c6b Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesGetTestJSON-250371350 Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesGetTestJSON-250371350-project Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: e16cc2e4e07b452889cc2d3346b32f3e Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesGetTestJSON-250371350-project Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '4090d37d-8183-4298-a412-a333a142f9f4'} Sep 01 16:30:46.630231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. (HTTP 404) (Request-ID: req-25291bae-58f6-452a-b7af-4d75f6230720) Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:46.631108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:30:46.632474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:30:46.633866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6d8af15f-c3ff-4c30-8f55-325afd5be9a9 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] Returning 404 to user: Volume 4090d37d-8183-4298-a412-a333a142f9f4 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6d8af15f-c3ff-4c30-8f55-325afd5be9a9 tempest-VolumesGetTestJSON-250371350 tempest-VolumesGetTestJSON-250371350-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4" status: 404 len: 109 microversion: 2.1 time: 0.100301 Sep 01 16:30:46.698365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 3/6] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:30:46 2022] GET /compute/v2.1/os-volumes/4090d37d-8183-4298-a412-a333a142f9f4 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:30:57.716302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f3386dee-569a-4379-8977-e721636d9856 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9dc2bee0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:30:57.845822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f3386dee-569a-4379-8977-e721636d9856 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/e46cf646-1b5d-4fa4-9002-ff78cf0bdd58" status: 200 len: 350 microversion: 2.1 time: 0.134892 Sep 01 16:30:57.847318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:30:57 2022] GET /compute/v2.1/os-volumes/e46cf646-1b5d-4fa4-9002-ff78cf0bdd58 => generated 350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:30:59.802341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7fa5b7d7-7b7c-4bcc-8209-5f165351e967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: .version_select at 0x7f6c9e5830d0>, body: {"keypair": {"name": "tempest-keypair-529192931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2L2XTujamJkhRPcPVLM4/FVgTr8ZVE3ZAzVKkIClh5zrXdXJEs9md0pWtxAA//qTJh4kyIHA7LBX6N+Hqtrxd7ezmzA87qU7cn/Sk+uf5gacHlvqaqvvKBRyqFgbkA7Q=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:30:59.863314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-848994210", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:00.024300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-7fa5b7d7-7b7c-4bcc-8209-5f165351e967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:00.042302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-7fa5b7d7-7b7c-4bcc-8209-5f165351e967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:00.119173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] validate_networks() for [('89dca715-3b69-4c8b-b0a5-998f42aee633', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:31:00.183549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7fa5b7d7-7b7c-4bcc-8209-5f165351e967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.020235 Sep 01 16:31:00.184225 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 4/8] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:30:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:31:00.203105 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6b909c19-de4b-4b1f-8660-88f9d09183e5 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9db69670>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:00.310898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6b909c19-de4b-4b1f-8660-88f9d09183e5 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/20ac598c-6f48-4b25-91d6-c4e3dade4a73" status: 200 len: 349 microversion: 2.1 time: 0.117552 Sep 01 16:31:00.311683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:31:00 2022] GET /compute/v2.1/os-volumes/20ac598c-6f48-4b25-91d6-c4e3dade4a73 => generated 349 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:01.714099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:31:01.715141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:31:01.723460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:31:01.724575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:31:01.727239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:31:01.759507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:01.762693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:01.765959 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:01.766996 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:01.770564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:01.771756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:01.839221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:01.902572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for user 0d4f8f3a6d42456d8e5cfbe20e54687a and project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:01.932967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:31:01.936898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:31:02.015787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8304743a-4651-4a37-9c37-d57bee5b81d9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'create', calling method: .version_select at 0x7f6c9db69ca0>, body: {"keypair": {"name": "tempest-keypair-1934576524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJX5lkGtKzEz/ieS0f5yM+FTEakvSAq6Rhu2f84/NTG84NNlsRAY7p1NyKcNqhAR7s2Bo/z4Ol75o7fWKn8M95vl5REY3dKCAlgfojQ+jig7hICGTN99XLYETuWB6M2/4Q=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:02.088133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-8304743a-4651-4a37-9c37-d57bee5b81d9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:02.097344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-8304743a-4651-4a37-9c37-d57bee5b81d9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for user a328e946d6d4441ca7ecbb3a20d2a611 and project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:02.152108 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-40ac9658-d706-4480-9c3a-1a66f21b1b58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.686951 Sep 01 16:31:02.168585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 5/10] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:30:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:31:02.200586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ddbafd4e-76b6-4cbc-9c88-98389a6140a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:02.205964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ddbafd4e-76b6-4cbc-9c88-98389a6140a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:02.250788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8304743a-4651-4a37-9c37-d57bee5b81d9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.539356 Sep 01 16:31:02.265330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 6/11] 10.222.0.58 () {62 vars in 1200 bytes} [Thu Sep 1 16:31:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 555 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 01 16:31:02.334339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-545311c4-eb1b-4a89-be9d-a9df869677ce tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9db0f160>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:02.412757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-545311c4-eb1b-4a89-be9d-a9df869677ce tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0d504ac1-896b-42f7-acef-31d3b6f6d74e" status: 200 len: 351 microversion: 2.1 time: 0.082457 Sep 01 16:31:02.421512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 7/12] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:31:02 2022] GET /compute/v2.1/os-volumes/0d504ac1-896b-42f7-acef-31d3b6f6d74e => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:31:02.428832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c3c7f8a3-8c1a-4ef6-9d13-e9de363c69fd tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9dc0e040>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:02.551384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ddbafd4e-76b6-4cbc-9c88-98389a6140a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:02.593378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ddbafd4e-76b6-4cbc-9c88-98389a6140a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1221 microversion: 2.1 time: 0.419203 Sep 01 16:31:02.601513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 6/13] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:02 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1221 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:02.633461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c3c7f8a3-8c1a-4ef6-9d13-e9de363c69fd tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.209996 Sep 01 16:31:02.634369 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 8/14] 10.222.0.58 () {58 vars in 1134 bytes} [Thu Sep 1 16:31:02 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:02.650092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a440b202-5c2c-4fe3-9440-7ffe2e13a56c tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9d2c6d30>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:02.928925 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2004946915", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:02.944516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a440b202-5c2c-4fe3-9440-7ffe2e13a56c tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.298081 Sep 01 16:31:02.945932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 7/15] 10.222.0.58 () {58 vars in 1149 bytes} [Thu Sep 1 16:31:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:02.968323 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6f40e2e1-9d82-4f39-8950-da5281d3933e tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9d2c6e50>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:03.190064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] validate_networks() for [('89dca715-3b69-4c8b-b0a5-998f42aee633', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:31:03.241768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6f40e2e1-9d82-4f39-8950-da5281d3933e tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.277885 Sep 01 16:31:03.242374 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1134 bytes} [Thu Sep 1 16:31:02 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:03.256062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-48bd47a5-36ba-49c9-bb46-ba31ad49d0a4 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9d2ebee0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:03.518253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-48bd47a5-36ba-49c9-bb46-ba31ad49d0a4 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.266509 Sep 01 16:31:03.518836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 9/17] 10.222.0.58 () {58 vars in 1167 bytes} [Thu Sep 1 16:31:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:31:03.540625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-eba5179d-996c-43a7-a398-0475ed8678bf tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9d2eb8b0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:03.684171 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-eba5179d-996c-43a7-a398-0475ed8678bf tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.147447 Sep 01 16:31:03.684965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 10/18] 10.222.0.58 () {58 vars in 1170 bytes} [Thu Sep 1 16:31:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:03.699393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d5524172-4917-4b10-bd37-86dd30fa4619 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9e584700>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:03.845104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d5524172-4917-4b10-bd37-86dd30fa4619 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.149567 Sep 01 16:31:03.855956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 11/19] 10.222.0.58 () {58 vars in 1155 bytes} [Thu Sep 1 16:31:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:03.878395 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1f7e5ab6-01a5-48fe-ac12-314c1d0e5780 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9d2721f0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:04.010586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1f7e5ab6-01a5-48fe-ac12-314c1d0e5780 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.143869 Sep 01 16:31:04.013630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 12/20] 10.222.0.58 () {58 vars in 1188 bytes} [Thu Sep 1 16:31:03 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:04.029618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ecdc8504-b423-49c8-9114-c89a7314ffd2 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] Calling method '.version_select at 0x7f6c9d276e50>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:04.178963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ecdc8504-b423-49c8-9114-c89a7314ffd2 tempest-VolumesTestJSON-2045567468 tempest-VolumesTestJSON-2045567468-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.154880 Sep 01 16:31:04.179844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 13/21] 10.222.0.58 () {58 vars in 1155 bytes} [Thu Sep 1 16:31:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:05.265750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:31:05.266826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:31:05.267405 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:31:05.267892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:31:05.268473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:31:05.300200 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:05.300868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:05.302010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:05.303223 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:05.306974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:05.307582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:05.385380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:05.396591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for user 0d4f8f3a6d42456d8e5cfbe20e54687a and project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:05.459990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:31:05.473953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:31:05.484897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-114467053", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "networks": [{"uuid": "0a81e6c5-4e1d-4c89-8bee-08651c0ced8b"}]}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:05.653064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] validate_networks() for [('0a81e6c5-4e1d-4c89-8bee-08651c0ced8b', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:31:05.686109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c972dab5-839b-4907-9189-94c0c91ab40a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.761521 Sep 01 16:31:05.687374 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 9/22] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:31:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:31:05.711771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cb12185b-6eac-414a-a4fd-39dbd26c45d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:05.712815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cb12185b-6eac-414a-a4fd-39dbd26c45d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:05.912868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cb12185b-6eac-414a-a4fd-39dbd26c45d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:05.996987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cb12185b-6eac-414a-a4fd-39dbd26c45d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1222 microversion: 2.1 time: 0.301990 Sep 01 16:31:06.000947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 10/23] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:05 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1222 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:07.031104 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e5355c64-529a-4eaf-920a-8aa6528b2703 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:07.032491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e5355c64-529a-4eaf-920a-8aa6528b2703 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:07.438283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e5355c64-529a-4eaf-920a-8aa6528b2703 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:07.460678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e5355c64-529a-4eaf-920a-8aa6528b2703 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1222 microversion: 2.1 time: 0.440225 Sep 01 16:31:07.465015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 11/24] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:07 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1222 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:07.691548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:31:07.692057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:31:07.692428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:31:07.692836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:31:07.693246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:31:07.739078 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:07.742782 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:07.743278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:07.744062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:07.744648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:07.744965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:07.799712 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e721f5a2-af4a-429b-b113-0efc1d0642d4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: .version_select at 0x7f6c9da5df70>, body: {"keypair": {"name": "tempest-keypair-1433494585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnR8Gqm2dozGMn9zoPkQE/P7yWlWiOtCOEnJ8BrfktyNvqN4FFuGofUNiA+PcJrJSXGDtXWMz9vym3dbWs4RtjBES6IwEBS7F1G8rKr2wzfvMyejU+2LBYdqBfU9ub9CA=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:07.807444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Getting quotas for project 19bb3b3c67024a7bbe30ba1b59e7f50a. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:07.822688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Getting quotas for user f69ac454b5a64e6d83188ad2b8e107d4 and project 19bb3b3c67024a7bbe30ba1b59e7f50a. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:07.836146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-e721f5a2-af4a-429b-b113-0efc1d0642d4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:07.843984 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-e721f5a2-af4a-429b-b113-0efc1d0642d4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for user 4ecfc51400414558b8389a9c35b2fa1c and project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:07.856288 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:31:07.858727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:31:07.915433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e721f5a2-af4a-429b-b113-0efc1d0642d4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.449076 Sep 01 16:31:07.917536 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 12/25] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:31:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:08.016828 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2b7ca52b-252f-4b61-a6ca-9a52c825c5d5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.092691 Sep 01 16:31:08.022274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 14/26] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:31:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:31:08.032002 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9ff64446-3a81-442a-9d3f-cadfa504525f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:08.032885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9ff64446-3a81-442a-9d3f-cadfa504525f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:08.154618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1937131815", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56174d1-438e-442e-9134-7098a8e04072"}], "security_groups": [{"name": "tempest-securitygroup--1525000378"}], "key_name": "tempest-keypair-529192931", "user_data": "}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:08.267073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9ff64446-3a81-442a-9d3f-cadfa504525f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:08.285918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9ff64446-3a81-442a-9d3f-cadfa504525f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1214 microversion: 2.1 time: 0.258538 Sep 01 16:31:08.297176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 13/27] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:08 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1214 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:08.482003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:08.483026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:08.501390 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:08.501912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:08.505416 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:08.506210 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:08.510964 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:08.511474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:09.046439 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] validate_networks() for [('b56174d1-438e-442e-9134-7098a8e04072', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:31:09.585130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:09.605203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-09acf1ff-c725-4f81-98fc-92b33688cb77 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1274 microversion: 2.1 time: 1.127205 Sep 01 16:31:09.633427 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 14/28] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:08 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1274 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:09.641930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:09.642701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:09.687713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:09.687713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:09.687944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:09.697846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:09.701049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:09.704145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:10.348609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:10.365874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0f8e3329-b9da-421d-ac1a-7adc10e91d13 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1210 microversion: 2.1 time: 0.729621 Sep 01 16:31:10.367657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 15/29] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:09 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1210 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:10.628559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:10.630110 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:10.640780 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:10.657867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:10.663744 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:10.672315 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:10.675329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:10.676255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:11.605168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:11.620537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7b7f744e-4d46-4d6d-ad4e-65c133973164 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1280 microversion: 2.1 time: 0.995903 Sep 01 16:31:11.641267 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 16/30] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:10 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1280 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:11.649754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-741340315", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "336cacce-0ee7-4670-923c-a066f6157763"}], "security_groups": [{"name": "tempest-securitygroup--1322921432"}], "key_name": "tempest-keypair-1934576524", "user_data": "}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:12.248498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] validate_networks() for [('336cacce-0ee7-4670-923c-a066f6157763', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:31:12.364300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:31:12.365222 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:31:12.365608 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:31:12.366580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:31:12.367177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:31:12.391752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:12.399960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:12.401119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:12.405513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:12.411005 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:12.413951 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:12.483595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:12.497269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:12.534112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:31:12.546363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:31:12.730869 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fbeb6265-9e68-4a3d-9966-e2ec0c5c79e4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.581596 Sep 01 16:31:12.737859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 15/31] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:31:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 4589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:31:12.755933 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:12.758005 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:12.785786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:12.786956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:12.788549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:12.791647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:12.792477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:12.795616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:13.917424 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:13.984890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ba609684-4eb2-47b1-9ff2-122014fcd44e tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1272 microversion: 2.1 time: 1.240044 Sep 01 16:31:13.991591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 16/32] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:12 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1272 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:14.007107 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:14.008357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:14.030545 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:14.031362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:14.032330 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:14.033714 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:14.035694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:14.037746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:14.873079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:31:14.874364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:31:14.874988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:31:14.875705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:31:14.876331 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:31:14.914085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:14.918948 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:14.919595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:14.923421 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:14.925728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:14.926945 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:14.978964 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:14.987239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for user a328e946d6d4441ca7ecbb3a20d2a611 and project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:15.016645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:31:15.019907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:31:15.181148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:15.200898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1e4700c0-8ba0-4c03-89e9-339df3f1b0ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.555176 Sep 01 16:31:15.211178 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f21a2db2-b1bd-41dc-af91-301f1dbcbbb5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 1.200566 Sep 01 16:31:15.215395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 17/33] 10.222.0.58 () {62 vars in 1188 bytes} [Thu Sep 1 16:31:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 3572 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:31:15.220487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:15.221113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:15.232690 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 17/34] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:13 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:15.237907 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:15.263937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:15.265091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:15.265620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:15.266068 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:15.266853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:15.272673 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:15.278175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:15.295223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:15.295746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:15.296364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:15.297190 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:15.297746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:15.298340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:16.029979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:16.094669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4d1315d2-6590-4180-a1ab-6daba9abeab0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1293 microversion: 2.1 time: 0.877952 Sep 01 16:31:16.099358 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 18/35] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:15 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1293 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:16.128454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6dfa6249-84a4-4db1-9c5d-8b0a072f08eb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:16.130760 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6dfa6249-84a4-4db1-9c5d-8b0a072f08eb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:16.416821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6dfa6249-84a4-4db1-9c5d-8b0a072f08eb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:16.456962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6dfa6249-84a4-4db1-9c5d-8b0a072f08eb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:16.464414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6dfa6249-84a4-4db1-9c5d-8b0a072f08eb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:16.475521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6dfa6249-84a4-4db1-9c5d-8b0a072f08eb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1281 microversion: 2.20 time: 0.372615 Sep 01 16:31:16.478542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 19/36] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:16 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1281 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:16.509903 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-50047500", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ee03cb1-3beb-431b-9524-34072887e8c9"}], "security_groups": [{"name": "tempest-securitygroup--928679450"}], "key_name": "tempest-keypair-1433494585", "user_data": "}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:16.937190 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:16.947216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6eb61721-5bdf-4334-ab50-8f8b5643f697 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 1.713213 Sep 01 16:31:16.950605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 18/37] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:15 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:16.967266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:16.968252 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:16.974832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:16.978426 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:16.979188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:16.980194 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:16.980869 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:16.998580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:17.113195 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] validate_networks() for [('4ee03cb1-3beb-431b-9524-34072887e8c9', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:31:18.189521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:18.201987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ce56ef47-08f3-45fb-bbfd-1e07fce1370c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 1.238502 Sep 01 16:31:18.222506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 19/38] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:16 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:18.227932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:18.228559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:18.244711 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:18.245814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:18.250656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:18.252016 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:18.253493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:18.255109 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:19.004242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:19.022700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f8c4709d-3d7d-4503-a3ed-3771115b37b0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1299 microversion: 2.1 time: 0.797716 Sep 01 16:31:19.026557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 20/39] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:18 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1299 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:19.077862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:19.078571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:19.119849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:19.120350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:19.120787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:19.123066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:19.127998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:19.131438 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:19.594481 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:19.630331 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:19.635984 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:19.642451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1f8b2ee1-9c94-4d0b-820b-86e699f5ee3d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1339 microversion: 2.20 time: 0.614017 Sep 01 16:31:19.645122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:19 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1339 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:19.655068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:19.656455 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:19.672299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:19.673165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:19.675163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:19.677278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:19.679099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:19.681910 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:20.629950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:31:20.631420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:31:20.633169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:31:20.634024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:31:20.635534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:31:20.664625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:20.713317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:20.718634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:20.720766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:20.726556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:20.730894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:20.738394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:20.808920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:31:20.828193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for user 4ecfc51400414558b8389a9c35b2fa1c and project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:31:20.871079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:31:20.880478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:31:21.018856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-19c9cfc9-dfe5-4933-ae01-aa7518b2181a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.517541 Sep 01 16:31:21.027401 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:31:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 4548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:31:21.043600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:21.051162 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:21.099574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:21.100270 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:21.109932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:21.115815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:21.116537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:21.120041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:21.453180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:21.462221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2f6e53c0-0dca-4744-895a-2814a7056d3a tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 1.815442 Sep 01 16:31:21.470698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 22/42] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:19 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:21.485808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:21.489389 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:21.525457 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:21.527981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:21.531334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:21.537256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:21.539759 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:21.540602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:22.436647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:22.534804 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=20 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:22.934936 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:22.948609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c3128649-4f58-44ec-935a-c8dfe20ae1f7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 1.476709 Sep 01 16:31:22.949209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 23/43] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:21 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:23.021584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:23.036837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-08609f6d-25d6-4f7f-b486-d1a0558a0d02 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 2.007023 Sep 01 16:31:23.037321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 21/44] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:21 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:23.077153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:23.077783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:23.092933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.094416 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.095707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.099585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.100579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.101047 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.132102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c5391a-25a4-447a-841c-20fc410cc636", "tag": "7865488d-a0aa-4d46-a70c-266fbc62a9a4"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:23.171152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.173302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.175371 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.226116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Creating event network-changed:7865488d-a0aa-4d46-a70c-266fbc62a9a4 for instance b4c5391a-25a4-447a-841c-20fc410cc636 on hv-cinder-85220 Sep 01 16:31:23.227026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120693) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:31:23.227599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-92ba5a70-89e0-41a2-9e34-94da05658c64 req-a0e67862-31b9-4f63-b32d-c3cfc1212e7f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120693) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:31:23.229487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.236752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.237520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.238517 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.239132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.239720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.251892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.compute.rpcapi [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:31:23.259224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] Releasing lock "compute-rpcapi-router" {{(pid=120693) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:31:23.284222 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-882309a0-acc0-41de-a41e-99e5e4a04e92 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.297321 Sep 01 16:31:23.285295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 24/45] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:23.298217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:23.299046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:23.307243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.307793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.308177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.308905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.309901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.317239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.374447 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:23.384204 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:23.399308 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:23.404019 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-506f1abb-3663-436d-8d94-17d1c622795c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1339 microversion: 2.20 time: 0.344252 Sep 01 16:31:23.406387 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 22/46] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:23 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1339 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:23.505278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:23.514937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ed5a7039-2058-472f-8e0d-36466ba36daa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1288 microversion: 2.1 time: 0.227637 Sep 01 16:31:23.515521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 25/47] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:23 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1288 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:23.523980 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:23.530843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:23.543074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.544691 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.546520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.547928 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.552052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.553471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.727912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814dbaf0-6089-4980-827b-b9cb5bfc5eda", "tag": "a4f34254-a6f3-40e7-a19a-2bfbc8a70983"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:23.774059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.775206 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.776386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.806794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Creating event network-changed:a4f34254-a6f3-40e7-a19a-2bfbc8a70983 for instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda on hv-cinder-85220 Sep 01 16:31:23.808303 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120692) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 16:31:23.809823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c263a90d-e29c-4be3-a3ba-cb6d8702fe4d req-9114ad75-de9c-4ec1-b46a-87b4a7580f11 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120692) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 16:31:23.812583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.813499 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.814247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.815248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.815946 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.817090 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.830951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.compute.rpcapi [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 16:31:23.837794 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:23.845373 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=120692) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 16:31:23.851861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-96812adb-de58-403f-a408-810b7ed147cc tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.332759 Sep 01 16:31:23.854909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 26/48] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:23 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:23.883105 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b805cc44-e548-430e-b718-8ae13db0a5c9 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.471416 Sep 01 16:31:23.883928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 23/49] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:23.983500 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:23.984189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:23.995958 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:23.997348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:23.998530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:23.999569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.000286 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.000926 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.057893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:24.059344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:24.074372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.077689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.078323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.085086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.086711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.090086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.511213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:24.524554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-062b1516-6e4a-460b-a633-ff3a684d0495 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.544842 Sep 01 16:31:24.528450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 27/50] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:23 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:24.538793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:24.542837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:24.554307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.555738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.556396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.557369 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.558060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.558769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:24.559140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.573836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-357eef12-7209-4f23-9339-9b8f28a2c57e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.517527 Sep 01 16:31:24.574119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 24/51] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:24 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:24.588483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:24.591737 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:24.602287 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.603199 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.609826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.610663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.611072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.611498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.704904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:24.715201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-168ed861-8c12-4c1c-bfa4-fc29dea222a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1288 microversion: 2.1 time: 0.139016 Sep 01 16:31:24.718377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 25/52] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:24 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1288 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:24.827248 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:24.837405 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:24.839238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:24.841434 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0eb67dbe-2d6a-4c3a-8682-e17a0efc3e09 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.311676 Sep 01 16:31:24.842798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 28/53] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:24 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:24.881437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:24.882820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:24.903557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.905364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.905975 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:24.907323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:24.908059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:24.908754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.122993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:25.131198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-999e3b50-3fa2-4bfc-a7ec-879cb0e38854 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.258135 Sep 01 16:31:25.132512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 26/54] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:24 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:25.338035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-8451c3cf-0b54-448e-bfae-f5b599c4d95b req-c6f2f371-3f17-4513-b8f6-2e8440637efd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f025a61-b696-4513-bf6f-c598683e0740", "tag": "bdb2ff86-ad10-430d-982b-7a22e1a58447"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:25.354852 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-8451c3cf-0b54-448e-bfae-f5b599c4d95b req-c6f2f371-3f17-4513-b8f6-2e8440637efd service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.355837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-8451c3cf-0b54-448e-bfae-f5b599c4d95b req-c6f2f371-3f17-4513-b8f6-2e8440637efd service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.357057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-8451c3cf-0b54-448e-bfae-f5b599c4d95b req-c6f2f371-3f17-4513-b8f6-2e8440637efd service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.378991 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-8451c3cf-0b54-448e-bfae-f5b599c4d95b req-c6f2f371-3f17-4513-b8f6-2e8440637efd service nova] Creating event network-changed:bdb2ff86-ad10-430d-982b-7a22e1a58447 for instance 6f025a61-b696-4513-bf6f-c598683e0740 on hv-cinder-85220 Sep 01 16:31:25.387811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-8451c3cf-0b54-448e-bfae-f5b599c4d95b req-c6f2f371-3f17-4513-b8f6-2e8440637efd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055700 Sep 01 16:31:25.388843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 29/55] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:25.552537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:25.553397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:25.559486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.560140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.560836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.562428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.563065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.563784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.597913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:25.598698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:25.605155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.605636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.606134 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.606917 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.607371 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.607864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.798240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:25.819327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-595af541-5923-44b6-b61a-68482897ddcc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.265204 Sep 01 16:31:25.830891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 27/56] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:25 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:25.838842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:25.839781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:25.849876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.852232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.854782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.855661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.857666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.858871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.883922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:25.917434 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d117e644-63a5-403a-9e1c-16f706f1fb12 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.323956 Sep 01 16:31:25.922393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 30/57] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:25 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:25.927644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:25.928280 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:25.966451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.968858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.969502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:25.970730 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:25.971341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:25.972202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:26.563886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:26.571817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a201cd0b-11b2-43cc-8e63-b7ee57256b2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1288 microversion: 2.1 time: 0.739675 Sep 01 16:31:26.575656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 28/58] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:25 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1288 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:26.586441 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-411b6ffd-be79-4fcd-948c-eb63cd470bc1 req-a9d66100-7499-4cbf-a87f-68999ace5299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7351def-25a9-4fd3-ab43-54ae606aa063", "tag": "d0735aec-28ea-4319-9808-1fa1397ad01f"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:26.605544 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-411b6ffd-be79-4fcd-948c-eb63cd470bc1 req-a9d66100-7499-4cbf-a87f-68999ace5299 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:26.606048 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-411b6ffd-be79-4fcd-948c-eb63cd470bc1 req-a9d66100-7499-4cbf-a87f-68999ace5299 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:26.611268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-411b6ffd-be79-4fcd-948c-eb63cd470bc1 req-a9d66100-7499-4cbf-a87f-68999ace5299 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:26.637794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-411b6ffd-be79-4fcd-948c-eb63cd470bc1 req-a9d66100-7499-4cbf-a87f-68999ace5299 service nova] Creating event network-changed:d0735aec-28ea-4319-9808-1fa1397ad01f for instance f7351def-25a9-4fd3-ab43-54ae606aa063 on hv-cinder-85220 Sep 01 16:31:26.651539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-411b6ffd-be79-4fcd-948c-eb63cd470bc1 req-a9d66100-7499-4cbf-a87f-68999ace5299 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073511 Sep 01 16:31:26.652389 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 29/59] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:26.665568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:26.667385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:26.682812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:26.688311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:26.688876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:26.689946 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:26.690510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:26.690933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:26.848033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:26.869123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:26.870942 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:26.873135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6401ff97-22f2-400c-8934-7250f3ad42e7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.949440 Sep 01 16:31:26.874235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 31/60] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:25 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:26.879465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:26.883587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:26.900896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:26.902693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:26.903328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:26.904750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:26.906525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:26.907159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:26.946927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:27.430153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:27.438673 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-098807a9-9170-4fee-a155-a692c1d6c7e7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.784738 Sep 01 16:31:27.448828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 30/61] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:26 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:27.451445 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:27.455077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:27.455903 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:27.468390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cae13d48-a8b2-4aab-bf71-6cc9d6c0656c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.592889 Sep 01 16:31:27.468836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:27.469415 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:27.469972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 32/62] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:26 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:27.470084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:27.471302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:27.472016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:27.472626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:27.598295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:27.598909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:27.605613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:27.606093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:27.610672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:27.613702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:27.617201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:27.617655 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:27.741812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:27.753146 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f6507d38-8207-4bdb-a1a4-db2f5e3ac4d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1294 microversion: 2.1 time: 0.157483 Sep 01 16:31:27.753745 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 33/63] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:27 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1294 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:27.805972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:27.828053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-68808429-ac43-470f-947b-37ecedb2de6b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.377677 Sep 01 16:31:27.828644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 31/64] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:27 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:27.898358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:27.899796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:27.921146 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:27.923860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:27.924386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:27.924812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:27.928640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:27.929115 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:27.929547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.149519 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:28.157699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:28.159152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:28.160361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a9dd2329-863f-4e1c-96b8-e643df67f35d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.266198 Sep 01 16:31:28.160789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 34/65] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:27 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:28.462374 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:28.463060 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:28.472596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.473717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.474719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.475628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.476361 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.476973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.500234 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:28.501534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:28.513378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.513627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.514062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.514799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.515334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.515677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.776277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:28.789052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cadf88d4-ae22-469a-9920-cd2907eece5b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.328570 Sep 01 16:31:28.789052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 32/66] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:28 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:28.793801 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-61e78cca-6146-44d2-a435-e11d14976e30 req-498b930a-f47d-4cb5-8fb4-129c31e904e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:28.820212 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-61e78cca-6146-44d2-a435-e11d14976e30 req-498b930a-f47d-4cb5-8fb4-129c31e904e2 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.820852 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-61e78cca-6146-44d2-a435-e11d14976e30 req-498b930a-f47d-4cb5-8fb4-129c31e904e2 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.821096 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-61e78cca-6146-44d2-a435-e11d14976e30 req-498b930a-f47d-4cb5-8fb4-129c31e904e2 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.837740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-61e78cca-6146-44d2-a435-e11d14976e30 req-498b930a-f47d-4cb5-8fb4-129c31e904e2 service nova] Creating event network-changed:9934d19e-6301-4c24-8a8b-6d0bf27e8bbd for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 on hv-cinder-85220 Sep 01 16:31:28.844898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-61e78cca-6146-44d2-a435-e11d14976e30 req-498b930a-f47d-4cb5-8fb4-129c31e904e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055834 Sep 01 16:31:28.846145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 33/67] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:28.846798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:28.852302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:28.853273 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:28.858048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ee542f77-a39b-461b-9270-a2f1eb5260ac tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.365031 Sep 01 16:31:28.859940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 35/68] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:28 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:28.862160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.862810 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.863400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.864310 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.865239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.865843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:28.866091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.866477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:28.872130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:28.896117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.899131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.899660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.900337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:28.905193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:28.907729 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:28.975924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:28.985932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ffd89a0a-b725-44af-8740-4553d8a69b9e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1294 microversion: 2.1 time: 0.138180 Sep 01 16:31:28.987146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:28 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:29.143204 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:29.153814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7abf83be-4218-463f-a530-ae56e6a073a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.292456 Sep 01 16:31:29.154948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 36/70] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:28 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:29.185103 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:29.185989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:29.193433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:29.194141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:29.194665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:29.195561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:29.196015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:29.196517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:29.361034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:29.375711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:29.378433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:29.380207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-90b96b15-a84e-4ae8-b60c-9526ad30d4b9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.201033 Sep 01 16:31:29.381009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:29 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:29.812510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:29.813321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:29.826700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:29.827191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:29.827636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:29.828350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:29.828878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:29.832201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:29.880019 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:29.881384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:29.893901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:29.894448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:29.894895 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:29.896196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:29.896196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:29.896406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.252101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.269605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b224c8c2-74a1-40e1-894b-58b47806cab0 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.461822 Sep 01 16:31:30.273260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 37/72] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:29 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:30.279604 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.290046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5fe73207-5b43-4f0c-bffb-9dd190fd2b71 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.411704 Sep 01 16:31:30.290684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 36/73] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:29 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:30.295138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:30.298823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:30.299654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:30.302321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:30.314240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:30.314726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:30.316968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:30.317346 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.317456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:30.318286 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.319443 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:30.320120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:30.320803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:30.321459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:30.322317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.324051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.462752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.483144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-90ccb704-e1c3-4a2e-ae93-23c6da60ef6f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1294 microversion: 2.1 time: 0.203017 Sep 01 16:31:30.483144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 38/74] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:30 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1294 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:30.488448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:30.488448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:30.505810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:30.506427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:30.506856 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.507577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:30.508087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:30.508512 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:30.575715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.583761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ed9800cd-dbcc-4836-8703-e005bfad0a26 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.292024 Sep 01 16:31:30.584337 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 37/75] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:30 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:30.701016 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.710427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.712084 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:30.713668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-18adbff4-16f3-46e8-a995-a0df8ad4b299 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.234164 Sep 01 16:31:30.714504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:30 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:31.298057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=38 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:31.303628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:31.304465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:31.312963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:31.313573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:31.320318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.321177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.321296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.321666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.322106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.322349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.322864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.323319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.323703 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.323819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.324489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.325138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.540231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.551339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.552500 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-dd15e2d2-8359-47b5-af3c-83bd79e38a61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.243971 Sep 01 16:31:31.554786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 40/77] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:31 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:31.559975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:31.560593 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:31.563242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-859886b6-64f2-40b0-896d-548eb5df9232 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.266049 Sep 01 16:31:31.564009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 38/78] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:31 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:31.578620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.578738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.579333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.580664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.581327 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.581953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.611565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:31.619442 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:31.633331 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.635560 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.637824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.639399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.641641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.642959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.672025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.681736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fcbeb350-208a-424a-8f29-8c1e6da0dab8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1294 microversion: 2.1 time: 0.125583 Sep 01 16:31:31.682667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 41/79] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:31 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:31.738514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:31.739585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:31.752339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.753048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.753666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.754626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:31.755284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:31.755860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:31.942255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.950546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-838b4f79-edaf-4eab-a94c-b70fcc6a9d31 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.349070 Sep 01 16:31:31.951134 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 39/80] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:31 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:31.971313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.985065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.987200 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:31.988653 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-16dc5630-4eb5-4f00-9b9e-ac1066f744a1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.255535 Sep 01 16:31:31.989620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 42/81] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:31 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:31:32.578605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:32.579963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:32.590056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:32.591685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:32.606216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:32.607302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:32.608415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:32.609145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:32.609733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:32.610295 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:32.611754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:32.612355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:32.612977 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:32.613883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:32.614286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:32.614831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.010814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.025056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fe4ac84b-042b-4d2b-be33-bc3c59a84d28 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.440170 Sep 01 16:31:33.028224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 43/82] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:32 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:33.039007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.061364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:33.071379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5ee9a525-72c2-45a8-82c7-94a590461c68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.498137 Sep 01 16:31:33.077598 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 40/83] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:32 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:33.090762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:33.111672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:33.119959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:33.124074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:33.124577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:33.125015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.125747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:33.127430 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:33.131272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.138397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:33.141991 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:33.144922 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.145815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:33.146594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:33.148954 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.249843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:33.441893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.450657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-57219acb-808b-4c38-968e-30fde98c0581 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.421053 Sep 01 16:31:33.451660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 44/84] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:33 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:33.456923 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:33.457768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:33.471029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.474053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:33.474905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:33.475877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.476820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:33.477676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:33.478667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:33.482396 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3ec14045-6974-4bce-b40e-e8bb9261cff9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.403452 Sep 01 16:31:33.482990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 41/85] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:33 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:33.671731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.680134 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.681574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:33.682722 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-062396ce-7a50-45ef-9cd2-c4dd6fe56894 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.229720 Sep 01 16:31:33.683281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 45/86] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:33 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:34.051383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:34.051862 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:34.053644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=8 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:34.059203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.059694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.060133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.060831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.061286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.061710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.096526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:34.097138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:34.103185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.103674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.104114 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.104814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.105329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.106388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.240860 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:34.249245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7846fbb7-9a47-46e4-97f5-512006b06f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.201814 Sep 01 16:31:34.250107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 42/87] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:34 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:34.269571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:34.277834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-204f64de-6431-4d69-bd91-0a2d234e2524 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.184511 Sep 01 16:31:34.278555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 46/88] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:34 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:34.479118 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:34.480804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:34.488173 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.488688 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.489123 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.489820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.490307 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.491012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.504398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:34.505481 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:34.519513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.520118 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.520682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.521498 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.522150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.522781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.870640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:34.895836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-54325fa6-0cf7-4470-8a5d-20f07d6b0f2e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.421302 Sep 01 16:31:34.907838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 43/89] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:34 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:34.920315 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:34.921246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:34.928249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.928981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.929620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.930981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:34.931646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:34.932264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:34.964883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:34.975661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d8aa59a5-244a-4e76-ad9f-f41daef8b47c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.476377 Sep 01 16:31:34.977875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 47/90] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:34 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:35.072191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-90a65a24-1f6c-4f96-b52f-491ed348aa03 req-0d4b863f-c6bd-4b1d-a667-6fcd00d56b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5391a-25a4-447a-841c-20fc410cc636", "name": "network-vif-plugged", "status": "completed", "tag": "7865488d-a0aa-4d46-a70c-266fbc62a9a4"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:35.084686 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-90a65a24-1f6c-4f96-b52f-491ed348aa03 req-0d4b863f-c6bd-4b1d-a667-6fcd00d56b02 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:35.085819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-90a65a24-1f6c-4f96-b52f-491ed348aa03 req-0d4b863f-c6bd-4b1d-a667-6fcd00d56b02 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:35.086533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-90a65a24-1f6c-4f96-b52f-491ed348aa03 req-0d4b863f-c6bd-4b1d-a667-6fcd00d56b02 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:35.108260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-90a65a24-1f6c-4f96-b52f-491ed348aa03 req-0d4b863f-c6bd-4b1d-a667-6fcd00d56b02 service nova] Creating event network-vif-plugged:7865488d-a0aa-4d46-a70c-266fbc62a9a4 for instance b4c5391a-25a4-447a-841c-20fc410cc636 on hv-cinder-85220 Sep 01 16:31:35.117659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-90a65a24-1f6c-4f96-b52f-491ed348aa03 req-0d4b863f-c6bd-4b1d-a667-6fcd00d56b02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137244 Sep 01 16:31:35.118291 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 48/91] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:35.272975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:35.274258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:35.286685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:35.288307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:35.289507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:35.292101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:35.293657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:35.294952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:35.548659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:35.558880 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:35.560757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:35.562615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d33419bd-d940-4d80-9732-1c5db53209d3 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.652990 Sep 01 16:31:35.563335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 44/92] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:34 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:35.568836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:35.569638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:35.576270 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:35.577088 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:35.577660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:35.578821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:35.579435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:35.579993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:35.991067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:35.995261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:35.999903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-36e06253-42f2-4b42-8a26-f935674e42d3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.732863 Sep 01 16:31:36.000493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 49/93] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:35 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:36.014686 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:36.017340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:36.033910 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.034675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.035293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.036427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.037040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.037633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.202130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:36.215632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-46ce5a4f-5a65-402e-9923-34e935d4592e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.645765 Sep 01 16:31:36.216543 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 45/94] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:35 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:36.261089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:36.263440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:36.278400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.279144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.279706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.280475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.281004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.281611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.525282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:36.537350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-65e49312-b4f9-4ca2-908d-3780203098a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.535796 Sep 01 16:31:36.538074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 50/95] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:36 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:36.543799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-01eedddb-c071-49ff-9be8-ec01ddc16fc2 req-421f62d4-b59d-45fd-84dd-ec8efcdded09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5bd3ba-2902-4456-a6f9-0f43241577ae", "tag": "a193b26d-37c2-41b3-a5b3-f879211927f9"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:36.556780 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-01eedddb-c071-49ff-9be8-ec01ddc16fc2 req-421f62d4-b59d-45fd-84dd-ec8efcdded09 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.557408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-01eedddb-c071-49ff-9be8-ec01ddc16fc2 req-421f62d4-b59d-45fd-84dd-ec8efcdded09 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.557955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-01eedddb-c071-49ff-9be8-ec01ddc16fc2 req-421f62d4-b59d-45fd-84dd-ec8efcdded09 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.574030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:36.579790 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-01eedddb-c071-49ff-9be8-ec01ddc16fc2 req-421f62d4-b59d-45fd-84dd-ec8efcdded09 service nova] Creating event network-changed:a193b26d-37c2-41b3-a5b3-f879211927f9 for instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae on hv-cinder-85220 Sep 01 16:31:36.586581 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-944c09e9-1739-4cd6-abce-bacc39e99348 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.335127 Sep 01 16:31:36.586944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-01eedddb-c071-49ff-9be8-ec01ddc16fc2 req-421f62d4-b59d-45fd-84dd-ec8efcdded09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046807 Sep 01 16:31:36.587959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 46/96] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:36 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:36.588197 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 51/97] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:36.603461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:36.605719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:36.612070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.612541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.612981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.613658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:36.614100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:36.614539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:36.747003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:36.754875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:36.756301 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:36.757386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-587304d9-fde5-433c-90a1-60d31b10fbeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.167945 Sep 01 16:31:36.757942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 47/98] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:36 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:37.029956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:37.030751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:37.037112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.037587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.038017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.038731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.039187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.039616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.136870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-645a88ac-1c40-4206-b5e6-dba03be8bda0 req-383ef9a4-74d3-43fd-918e-567e536de557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7351def-25a9-4fd3-ab43-54ae606aa063", "name": "network-vif-plugged", "status": "completed", "tag": "d0735aec-28ea-4319-9808-1fa1397ad01f"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:37.146514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-645a88ac-1c40-4206-b5e6-dba03be8bda0 req-383ef9a4-74d3-43fd-918e-567e536de557 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.146993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-645a88ac-1c40-4206-b5e6-dba03be8bda0 req-383ef9a4-74d3-43fd-918e-567e536de557 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.147420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-645a88ac-1c40-4206-b5e6-dba03be8bda0 req-383ef9a4-74d3-43fd-918e-567e536de557 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.159230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-645a88ac-1c40-4206-b5e6-dba03be8bda0 req-383ef9a4-74d3-43fd-918e-567e536de557 service nova] Creating event network-vif-plugged:d0735aec-28ea-4319-9808-1fa1397ad01f for instance f7351def-25a9-4fd3-ab43-54ae606aa063 on hv-cinder-85220 Sep 01 16:31:37.164339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-645a88ac-1c40-4206-b5e6-dba03be8bda0 req-383ef9a4-74d3-43fd-918e-567e536de557 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031050 Sep 01 16:31:37.165218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 48/99] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:31:37.168479 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.176209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-103de566-0612-4621-a287-f77804a18f21 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.151062 Sep 01 16:31:37.176769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 52/100] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:37 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:37.241337 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:37.242022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:37.248257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.248726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.249166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.249823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.250351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.250767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.383275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.391324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-00b46c0e-68e3-418c-9fb3-f0f85ef6253a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.154294 Sep 01 16:31:37.391890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 49/101] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:37 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:37.559406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:37.559940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:37.567067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.567554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.567993 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.568692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.569150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.569579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.610678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:37.611281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:37.617149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.617627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.618056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.618768 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.619218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.619634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.748811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.756534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cac4f6e8-51bd-4010-b9f9-0447f97f9a53 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.201551 Sep 01 16:31:37.757191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 53/102] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:37 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:37.774237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.779408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:37.780019 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:37.782022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d2c735f5-580a-43a7-9178-b4c081cbaf44 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.175108 Sep 01 16:31:37.782794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 50/103] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:37 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:37.786219 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.786783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.787286 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.788041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:37.788570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:37.789077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:37.917987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.926277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.927850 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:37.928973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-47247d6c-40d6-4dae-a3c1-0d8e133a2e42 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.153449 Sep 01 16:31:37.929514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 54/104] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:37 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:31:38.196414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:38.197016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:38.202911 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.203381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.203802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.204470 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.204912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.205325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.222865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:38.332874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:38.341099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-aabfe2e5-37d8-43ef-bc8b-2d62305ec620 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.148481 Sep 01 16:31:38.341662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 51/105] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:38 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:38.412311 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:38.412944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:38.419588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.420058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.420484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.421155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.421595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.422013 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.550641 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:38.558346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3bcee893-e1f9-4671-b2cb-0fbc9f11ae91 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.149980 Sep 01 16:31:38.558913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 55/106] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:38 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:38.778650 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:38.779226 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:38.785257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.785732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.786466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.787146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.787592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.788009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.802506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:38.803114 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:38.809114 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.809594 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.810030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.810755 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:38.811212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:38.811634 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:38.988057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:38.992069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:38.995627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7ac1407d-c740-4c30-9123-c8ead969b39b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.221570 Sep 01 16:31:38.996230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 52/107] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:38 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:38.999884 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6bd141b1-9131-4b7d-b036-4f6931febcd8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.201154 Sep 01 16:31:39.000585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 56/108] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:38 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:39.000694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:39.001225 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:39.007010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:39.007486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:39.007913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:39.008616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:39.009064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:39.009479 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:39.135829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:39.144325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:39.145750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:39.146851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-af2fb83f-7bc0-400e-b4bf-beb4e28a6de0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.149723 Sep 01 16:31:39.147400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 53/109] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:38 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:39.360702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:39.361278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:39.367883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:39.368468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:39.368775 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:39.369455 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:39.369902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:39.370357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:39.496823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:39.504375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a84fa207-0eac-4923-b54f-df3e3495ed7c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.147547 Sep 01 16:31:39.504937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 57/110] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:39 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:39.586715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:39.587349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:39.593400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:39.593877 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:39.594339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:39.595201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:39.595653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:39.596075 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:39.727176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:39.735963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b430e3b5-ae82-490e-aad8-0399d96c8d2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.153005 Sep 01 16:31:39.736528 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 54/111] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:39 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:40.016982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:40.017589 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:40.020368 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:40.020978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:40.023645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.024132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.024566 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.025255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.025710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.026132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.026882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.027356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.027785 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.028464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.028911 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.029330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.218538 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.222541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.226282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3b9ff9d4-75ca-4d49-ba58-97caa292fc81 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.213094 Sep 01 16:31:40.226855 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 58/112] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:40 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:40.230589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-53a3caf3-d190-4cbe-a474-24e39c3d8419 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.213527 Sep 01 16:31:40.231133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 55/113] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:40 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:40.231883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:40.232321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:40.238149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.238647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.239081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.239765 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.240217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.240640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.366483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.375036 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.376469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.377545 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e9b8da8f-6f20-43fe-8897-9353b96caf6e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.149784 Sep 01 16:31:40.378096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 59/114] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:40 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:40.524585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:40.525226 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:40.531737 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.532213 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.532644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.533328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.533775 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.534211 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.668132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.675825 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a7917ce6-5d59-412a-8c00-65e29be98ee3 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.154960 Sep 01 16:31:40.676389 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 56/115] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:40 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:40.756731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:40.757337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:40.763395 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.763875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.764312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.764998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:40.765461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:40.765962 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:40.900670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:40.911700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-816d6858-c20f-4370-af2a-f3c2ccd1c889 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.158681 Sep 01 16:31:40.923597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 60/116] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:40 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:41.247370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:41.247983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:41.251509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:41.252146 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:41.253972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.254468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.254894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.255564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.256006 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.256415 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.258069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.258737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.259031 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.259711 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.260167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.260588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.457212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:41.460496 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:41.467938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-345895ca-2cac-4e92-bb00-e9e97452a5d9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.220079 Sep 01 16:31:41.468950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6534e165-8a4b-4c64-8a9a-3e7d79db8720 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.225419 Sep 01 16:31:41.469121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 61/117] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:41 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:41.470281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 57/118] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:41 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:41.474534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:41.475227 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:41.481144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.481681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.482173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.482969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.483404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.483814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.628298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:41.637318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:41.638846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:41.639942 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-12b0134e-13b2-4cce-a173-9a0001f8f1e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.169610 Sep 01 16:31:41.640654 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 62/119] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:41 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:41.696618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:41.697579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:41.705073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.705568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.705983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.706706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.707179 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.707605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.853222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:41.862074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-27fc9c83-d36d-4cf9-ab7a-691b8360ec0c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.169488 Sep 01 16:31:41.863136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 58/120] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:41 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:41.938373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:41.939864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:41.947686 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.948159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.948618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:41.949307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:41.949935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:41.950683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.099260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:42.108940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d15ea6c9-d7d2-4fbf-80a2-4147290fee2c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.177060 Sep 01 16:31:42.109516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 63/121] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:41 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:42.491644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:42.492327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:42.498822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.499576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.500176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.501048 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.501557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.502040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.505243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:42.505809 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:42.513824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.514733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.515469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.516948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.517572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.518391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.756980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:42.782932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-563d737b-1a9b-45d2-a79a-0d48a7066e54 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.294923 Sep 01 16:31:42.796122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 59/122] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:42 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:42.804362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:42.804986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:42.812163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:42.813089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.813709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.814141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.814849 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.816193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.816769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.822171 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-291c1a23-3ebf-4d7d-b62d-ebb1c405d022 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.323858 Sep 01 16:31:42.825303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 64/123] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:42 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:42.883820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:42.884618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:42.892251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.897610 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.898223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:42.899051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:42.899703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:42.902735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.087618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:43.105536 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:43.111136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:43.112561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f403c5be-a3eb-47d5-bd87-664a6cd0457a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.315300 Sep 01 16:31:43.113739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 60/124] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:42 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:43.142530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-243c5f3e-2c8a-46dd-961c-6f1d8799ddb4 req-56d7c661-94da-4972-b7fe-742ad74bfcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814dbaf0-6089-4980-827b-b9cb5bfc5eda", "name": "network-vif-plugged", "status": "completed", "tag": "a4f34254-a6f3-40e7-a19a-2bfbc8a70983"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:43.157372 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:43.173549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-243c5f3e-2c8a-46dd-961c-6f1d8799ddb4 req-56d7c661-94da-4972-b7fe-742ad74bfcb4 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.174383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-243c5f3e-2c8a-46dd-961c-6f1d8799ddb4 req-56d7c661-94da-4972-b7fe-742ad74bfcb4 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.175622 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-243c5f3e-2c8a-46dd-961c-6f1d8799ddb4 req-56d7c661-94da-4972-b7fe-742ad74bfcb4 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.179939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0d62db69-848a-4599-9bff-6da6ef3e9da8 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.299438 Sep 01 16:31:43.182110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 65/125] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:42 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:43.204189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:43.204189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:43.221925 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-243c5f3e-2c8a-46dd-961c-6f1d8799ddb4 req-56d7c661-94da-4972-b7fe-742ad74bfcb4 service nova] Creating event network-vif-plugged:a4f34254-a6f3-40e7-a19a-2bfbc8a70983 for instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda on hv-cinder-85220 Sep 01 16:31:43.236160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-243c5f3e-2c8a-46dd-961c-6f1d8799ddb4 req-56d7c661-94da-4972-b7fe-742ad74bfcb4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115870 Sep 01 16:31:43.237684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 61/126] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:43.241187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.241692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.242132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.247051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.247591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.248032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.578032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:43.586598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-336ea35a-0945-4233-b0f8-84766bee66e9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.401517 Sep 01 16:31:43.587262 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 66/127] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:43 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:43.809638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:43.810888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:43.818787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.819482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.820097 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.820948 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.821617 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.823044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.846284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:43.847133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:43.854339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.855083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.855679 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.856642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:43.857447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:43.858723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:43.863481 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:44.214066 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.226091 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.234601 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f253882d-5043-4d08-ab56-836d72a76ab3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.430347 Sep 01 16:31:44.235276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 62/128] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:43 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:44.245110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-aa83e7e0-fa22-40e1-83ad-cb0da8a83d23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.402731 Sep 01 16:31:44.245743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 67/129] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:43 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:44.249770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:44.250814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:44.251420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:44.252053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:44.259377 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:44.259909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:44.260643 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:44.262217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:44.262921 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:44.263531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:44.264298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:44.265132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:44.265565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:44.266298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:44.266908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:44.267733 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:44.537708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.542307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.550780 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.552235 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.553371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a9494dc8-e440-4958-b9e2-a4cc3b64649b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.313906 Sep 01 16:31:44.553904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 63/130] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:44 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:44.555176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f474b1f8-dfa5-405d-b78d-71892f781899 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.305819 Sep 01 16:31:44.555777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 68/131] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:44 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:44.608658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:44.609637 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:44.617795 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:44.619314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:44.620200 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:44.621964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:44.623859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:44.624411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:44.977033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:44.990077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d535e219-65b3-497d-82cd-3d1d8fd25357 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.386055 Sep 01 16:31:44.990875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 69/132] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:44 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:45.257121 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:45.257735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:45.265288 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:45.266036 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:45.268714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:45.273159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.273555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.273691 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.274055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.274214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.275455 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.275455 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.275720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.276029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.277582 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.278278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.280552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.617886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:45.629820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-25b9e2a6-a4ef-415d-877e-d679368101f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.376248 Sep 01 16:31:45.638670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 64/133] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:45 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:45.647897 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-5b118681-be0f-41b8-ae77-56caffcf2819 req-c8149380-590c-4e6b-ad30-38431f481fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f025a61-b696-4513-bf6f-c598683e0740", "name": "network-vif-plugged", "status": "completed", "tag": "bdb2ff86-ad10-430d-982b-7a22e1a58447"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:45.665414 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:45.678436 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-536e5f42-4d21-4fcd-a9e4-c0157d551a32 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.417255 Sep 01 16:31:45.679555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 70/134] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:45 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:45.683513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5b118681-be0f-41b8-ae77-56caffcf2819 req-c8149380-590c-4e6b-ad30-38431f481fa8 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.684607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5b118681-be0f-41b8-ae77-56caffcf2819 req-c8149380-590c-4e6b-ad30-38431f481fa8 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.686464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5b118681-be0f-41b8-ae77-56caffcf2819 req-c8149380-590c-4e6b-ad30-38431f481fa8 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.689423 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:45.697747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:45.707218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-5b118681-be0f-41b8-ae77-56caffcf2819 req-c8149380-590c-4e6b-ad30-38431f481fa8 service nova] Creating event network-vif-plugged:bdb2ff86-ad10-430d-982b-7a22e1a58447 for instance 6f025a61-b696-4513-bf6f-c598683e0740 on hv-cinder-85220 Sep 01 16:31:45.708747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.709513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.710398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.712090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.712725 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.713313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.719714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-5b118681-be0f-41b8-ae77-56caffcf2819 req-c8149380-590c-4e6b-ad30-38431f481fa8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083303 Sep 01 16:31:45.721084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 65/135] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:45.727184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:45.727883 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:45.734268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.734815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.735367 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.736070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:45.736519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:45.737208 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:45.971798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:45.974901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:45.981542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-901a9346-75b1-409a-9f16-47a2ef30920f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1314 microversion: 2.1 time: 0.300794 Sep 01 16:31:45.982120 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 71/136] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:45 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:45.983919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:45.986399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:45.987614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d4a43d78-111d-442a-a16c-329dc274ef55 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.265485 Sep 01 16:31:45.989420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 66/137] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:45 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:46.012509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:46.013118 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:46.019141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:46.019621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:46.020054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:46.020744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:46.021197 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:46.021617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:46.179309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:46.189297 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5abd6b4a-6ec9-4d02-97e9-e47a47f3d199 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.181246 Sep 01 16:31:46.189937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:46 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:46.652549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:46.653251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:46.659222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:46.659716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:46.660146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:46.661250 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:46.661886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:46.662343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:46.709773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:46.709773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:46.709773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:46.709773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:46.710844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:46.710844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:46.710844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:46.710844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:46.880999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:46.898599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a0390b55-a0a6-4762-b985-7dff6fbbffdd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.249750 Sep 01 16:31:46.900360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:46 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:46.939275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:46.952351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6038a4e2-39ab-4218-859d-1305131fc3b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.250994 Sep 01 16:31:46.953220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 73/140] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:46 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:47.015296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:47.016372 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:47.019066 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:47.019841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:47.028628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.029294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.029927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.030853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.031450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.031566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.032294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.036316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.036847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.037590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.046057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.046057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.312565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:47.324816 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b56e2c89-61fa-4152-86f7-2c5cd759cba1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1501 microversion: 2.1 time: 0.321078 Sep 01 16:31:47.325944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 68/141] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:47 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:47.338053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:47.339407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:47.345732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:47.348506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.351099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.352203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.355823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.356365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.357778 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:47.358357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.359821 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:47.361399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-dfdd8b25-c142-42a6-885d-591a5653d761 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.350229 Sep 01 16:31:47.362513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 74/142] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:47 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:47.390435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:47.597466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:47.609009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b0c4635b-3092-4ed8-bfb3-a14b76b1ee96 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.281811 Sep 01 16:31:47.618418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 69/143] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:47 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:47.922952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:47.923562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:47.941190 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.944705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.951749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.953816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.954487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.956214 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.975249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:47.976242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:47.987294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.987978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.991994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:47.993978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:47.995503 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:47.996402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:48.486240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:48.494007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3b89d578-bf8a-4b61-8d44-8c4c66870179 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.576448 Sep 01 16:31:48.495086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 75/144] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:47 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:48.499402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:48.510012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0059aa52-be71-448e-898f-cdf042435f95 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.540706 Sep 01 16:31:48.510544 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 70/145] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:47 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:48.511463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:48.512167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:48.518413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:48.518992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:48.519640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:48.520513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:48.521166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:48.522059 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:48.632623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:48.633221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:48.640662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:48.641345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:48.641948 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:48.649527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:48.652910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:48.653514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:48.666247 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:48.680772 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:48.682702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:48.684044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-40b94397-a41b-4fde-bb36-5b87e792fc1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.184829 Sep 01 16:31:48.685328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 76/146] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:48 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:48.855867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:48.867649 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8a6b79e1-218e-4827-bc28-eb858ac4bc12 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.238612 Sep 01 16:31:48.868926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 71/147] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:48 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:49.064739 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9e18e64-092f-4c55-b307-50e61626efcc"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:49.071764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:49.083038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:49.084098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:49.085218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:49.086260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:49.086919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:49.087426 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:49.517102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:49.517758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:49.527632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:49.528119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:49.528553 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:49.532359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:49.532861 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:49.534554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:49.757095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:49.766959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a6989e82-fef6-440d-9a6a-0315a2e244c0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.254094 Sep 01 16:31:49.767906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 72/148] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:49 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:49.774744 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:49.775616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:49.789624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:49.790397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:49.791000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:49.791705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:49.792721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:49.793705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:49.995760 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:50.010483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5ee9cee6-7565-4815-9ad5-41e28c5e1880 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.241140 Sep 01 16:31:50.013404 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 73/149] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:49 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:50.032049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:50.033411 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:50.041022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.041460 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.041904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.043378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.043995 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.044575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.201015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:50.209774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:50.211381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:50.212463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-24974471-3cd7-448f-b397-5a3f170dc471 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.197957 Sep 01 16:31:50.213028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 74/150] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:50 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:50.217413 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-c93c3f02-a9d1-4848-92bc-c8d82c6231fe req-23f91398-fa84-49e4-b727-cef917a1b0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "name": "network-vif-plugged", "status": "completed", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:50.226851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c93c3f02-a9d1-4848-92bc-c8d82c6231fe req-23f91398-fa84-49e4-b727-cef917a1b0da service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.227317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c93c3f02-a9d1-4848-92bc-c8d82c6231fe req-23f91398-fa84-49e4-b727-cef917a1b0da service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.227886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c93c3f02-a9d1-4848-92bc-c8d82c6231fe req-23f91398-fa84-49e4-b727-cef917a1b0da service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.240311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-c93c3f02-a9d1-4848-92bc-c8d82c6231fe req-23f91398-fa84-49e4-b727-cef917a1b0da service nova] Creating event network-vif-plugged:9934d19e-6301-4c24-8a8b-6d0bf27e8bbd for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 on hv-cinder-85220 Sep 01 16:31:50.245947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-c93c3f02-a9d1-4848-92bc-c8d82c6231fe req-23f91398-fa84-49e4-b727-cef917a1b0da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031208 Sep 01 16:31:50.246660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 75/151] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:50.252643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:50.253459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:50.259644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.260124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.260556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.261271 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.261747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.262278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.392069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:50.400577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-dc186271-0419-4ffd-8362-4d7b919609c4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1367 microversion: 2.1 time: 0.152792 Sep 01 16:31:50.414050 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 76/152] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:50 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:50.790428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:50.791268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:50.798155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.798684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.799129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.799805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:50.800253 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:50.800663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:50.960886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:50.970778 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-902ab81e-3a1f-4f0d-a18d-3eb3d2867e5b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.185236 Sep 01 16:31:50.971498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 77/153] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:50 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:51.032987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:51.033637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:51.040017 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.040493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.040916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.041804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.043315 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.043886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.240573 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:51.251979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9e23d34f-4ed1-4d63-a6a3-3729e94286d4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.222703 Sep 01 16:31:51.259864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 78/154] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:51 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:51.270419 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:51.271269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:51.278560 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.280049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.281012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.281983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.282656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.283927 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.466473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:51.478018 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:51.480924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:51.482453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2abb0902-fb76-4ebf-8e4e-f8a2d191adae tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.221122 Sep 01 16:31:51.483947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 79/155] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:51 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:51.496111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:51.498149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:51.509257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.511467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.512235 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.513178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.514182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.515231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.690811 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:51.698987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-518a86a8-9988-4b76-8517-194ea04bafc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1556 microversion: 2.1 time: 0.213715 Sep 01 16:31:51.700113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 80/156] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:51 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1556 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:51.723101 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:51.723941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:51.738423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.738423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.738423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.738423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.738792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:51.738792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:51.853127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e9a3775d-04dc-437d-b755-4273fe50447e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135640 Sep 01 16:31:51.854519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 81/157] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:31:51 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:51.992237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:51.992838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:51.999634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:51.999933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:52.000363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:52.001051 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:52.001666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:52.002150 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:52.142975 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:52.151871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-41db073e-e9d4-4668-9fc2-792d07355951 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.162874 Sep 01 16:31:52.154373 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 82/158] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:51 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:52.272677 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:52.273286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:52.279825 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:52.280539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:52.281031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:52.281811 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:52.282504 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:52.282990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:52.449745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:52.459654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-22aed450-ad6e-4d6f-bc79-35267fe715cd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.190871 Sep 01 16:31:52.460717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 83/159] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:52 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:52.505340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:52.506018 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:52.512714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:52.513434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:52.514047 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:52.515086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:52.515711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:52.516275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:52.666403 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:52.675200 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:52.676625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:52.677715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6e56f430-9a59-4933-8238-52b230aa3d0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.176621 Sep 01 16:31:52.678300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 84/160] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:52 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:53.172969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:53.173625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:53.179560 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.180035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.180463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.181141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.181596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.182005 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.324580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:53.333030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d41f8caa-22bc-4007-9e5e-2e5654583794 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.163859 Sep 01 16:31:53.333938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 85/161] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:53 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:53.356742 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-c0ce645c-ca08-4c9e-bbc5-4bb8124dcc5d req-96d7a200-61ec-41e0-b420-3899a289dae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f025a61-b696-4513-bf6f-c598683e0740", "tag": "bdb2ff86-ad10-430d-982b-7a22e1a58447"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:53.366186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c0ce645c-ca08-4c9e-bbc5-4bb8124dcc5d req-96d7a200-61ec-41e0-b420-3899a289dae5 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.366723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c0ce645c-ca08-4c9e-bbc5-4bb8124dcc5d req-96d7a200-61ec-41e0-b420-3899a289dae5 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.367201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c0ce645c-ca08-4c9e-bbc5-4bb8124dcc5d req-96d7a200-61ec-41e0-b420-3899a289dae5 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.378894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-c0ce645c-ca08-4c9e-bbc5-4bb8124dcc5d req-96d7a200-61ec-41e0-b420-3899a289dae5 service nova] Creating event network-changed:bdb2ff86-ad10-430d-982b-7a22e1a58447 for instance 6f025a61-b696-4513-bf6f-c598683e0740 on hv-cinder-85220 Sep 01 16:31:53.383714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-c0ce645c-ca08-4c9e-bbc5-4bb8124dcc5d req-96d7a200-61ec-41e0-b420-3899a289dae5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030595 Sep 01 16:31:53.384348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 86/162] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:31:53.486885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:53.487730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:53.496798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.497278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.497792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.498443 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.498896 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.499314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.657658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:53.662005 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:53.669475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f124fc50-a09f-43f6-bb43-e2d934e914f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.192223 Sep 01 16:31:53.670068 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 87/163] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:53 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:53.701211 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:53.701974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:53.709760 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.710436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.711122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.711912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:53.712459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:53.713683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:53.869826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:53.879231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:53.880669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:53.881779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c2b17658-3ae8-4595-8dbc-2c76067b0d5a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.185415 Sep 01 16:31:53.882363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 88/164] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:53 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:54.354178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:54.356197 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:54.363067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:54.363700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:54.364192 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:54.365197 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:54.365828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:54.366266 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:54.521171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:54.530470 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8e5e4ee6-3708-4563-a0ff-cd96c55c781a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.180132 Sep 01 16:31:54.531365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 89/165] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:54 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:54.694829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:54.695901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:54.703875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:54.704603 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:54.705044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:54.710475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:54.711348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:54.713323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:54.870258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:54.877952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0710bf07-fa17-4e86-a5aa-b04ba277967d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1322 microversion: 2.1 time: 0.188140 Sep 01 16:31:54.878657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 90/166] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:54 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:54.906412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:54.907181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:54.913360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:54.913837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:54.914297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:54.914979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:54.915451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:54.915869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:55.048329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:55.057636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:55.059494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:55.061054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-16815222-2496-4e3a-a14c-267f1f67cb4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.160321 Sep 01 16:31:55.061771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 91/167] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:54 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:31:55.550442 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:55.551078 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:55.557725 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:55.558238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:55.558661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:55.559371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:55.559822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:55.560239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:55.714171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:55.722118 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bac8b8ad-aa14-4887-b3c7-df6221d1a759 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.175473 Sep 01 16:31:55.722788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 92/168] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:55 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:55.899212 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:55.899903 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:55.906370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:55.906851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:55.907284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:55.907973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:55.908425 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:55.908870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.059490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:56.067612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9625a97c-6ce1-42ee-a932-15426ba3f3e2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1516 microversion: 2.1 time: 0.172215 Sep 01 16:31:56.068475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 93/169] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:55 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:56.084586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:56.085184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:56.091751 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.092222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.092645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.093324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.093762 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.094174 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.228719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:56.236887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:56.238359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:56.239452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5510a0be-e2ee-401e-ba79-c2e216f5c152 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.158684 Sep 01 16:31:56.240007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 94/170] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:56 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:31:56.252956 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:31:56.255331 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:56.261805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.262313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.262746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.263431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.264236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.264664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.288662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'flavor' on Instance uuid 814dbaf0-6089-4980-827b-b9cb5bfc5eda {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:31:56.413417 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-80cfd80f-e00a-4b7c-8192-2227738a88c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda/action" status: 200 len: 32 microversion: 2.1 time: 0.164012 Sep 01 16:31:56.414027 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 95/171] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:31:56 2022] POST /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda/action => generated 32 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:31:56.423981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:56.424783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:56.431582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.432062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.433023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.433832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.434311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.434731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.566352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:56.574394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4e8f98f1-fdb6-4fef-b98d-041069e004e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.154351 Sep 01 16:31:56.575491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 96/172] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:56 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:56.743207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:56.743932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:56.749944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.750452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.750879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.751633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:56.752080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:56.752496 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:56.891743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:56.900701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ad65ae9c-2387-428c-98b0-c937f0e43422 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.161228 Sep 01 16:31:56.901912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 97/173] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:56 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:31:57.262862 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:57.263605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:57.266895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5a9d5dd6-c229-4111-9bc8-ff4f849698e5 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "POST /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.209274 Sep 01 16:31:57.267602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 77/174] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:31:49 2022] POST /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636/os-volume_attachments => generated 194 bytes in 8211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:31:57.272044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.272660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.274672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.275400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.276210 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.276863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.432743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:57.443571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:57.445716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:57.446789 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-36237f64-17f5-4a2c-a301-b240c67a88b5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.188441 Sep 01 16:31:57.447515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 98/175] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:57 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:31:57.596753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:57.597443 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:57.603530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.604529 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.604961 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.605694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.606101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.606553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.731965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:57.739831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-028b6057-6e37-4ca3-9f70-785ab4e4c656 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.147803 Sep 01 16:31:57.740404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 78/176] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:57 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:57.923749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:57.925294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:57.932454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.933224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.933810 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:57.934694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:57.935625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:57.936201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.085268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:58.093898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6fb20b44-a5a2-44a6-8d56-a7113b7e1572 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.174349 Sep 01 16:31:58.094508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 99/177] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:57 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:58.470501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:58.471223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:58.473690 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=90 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:31:58.478941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:58.479416 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:58.479850 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.480543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:58.480992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:58.481412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.612573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:58.621193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:58.622649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:58.623742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c81ce643-d227-46da-9f99-3055c032382f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.157061 Sep 01 16:31:58.624310 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 79/178] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:58 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:31:58.762238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:58.762857 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:58.770706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:58.771200 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:58.771629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.772327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:58.772812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:58.773217 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:58.969436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:58.977094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-41364562-3b3f-4b4a-bddc-b0c86761f559 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.220028 Sep 01 16:31:58.977661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 100/179] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:58 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:59.115350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:59.116572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:59.126410 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:59.126922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:59.127357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:59.128115 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:59.128635 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:59.129062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:59.260050 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:59.268371 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-151e7f9c-9cbd-4b43-a55a-832da05772ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.156835 Sep 01 16:31:59.268931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 80/180] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:59 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:31:59.646354 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:59.646960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:31:59.653571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:59.654049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:59.654516 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:59.655196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:31:59.655646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:31:59.656065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:31:59.803265 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:59.811577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:59.813024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:31:59.814124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-97c7e80b-54e4-471c-8b79-fd6cfc9ca3af tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.171646 Sep 01 16:31:59.814708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 101/181] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:31:59 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:31:59.997957 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:31:59.998762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:00.005294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:00.005781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:00.006242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:00.006945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:00.007576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:00.008072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:00.139003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:00.146779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6a0220ec-fde2-49ab-b202-da30ded431ec tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.153853 Sep 01 16:32:00.147350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 81/182] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:31:59 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:00.288433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:00.288972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:00.295670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:00.296149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:00.296581 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:00.297303 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:00.297754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:00.298177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:00.316316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:00.430884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:00.438743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3c25fdaf-e7a6-4eeb-99b0-1428660a858e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.154337 Sep 01 16:32:00.439370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 102/183] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:00 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:00.836907 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:00.837510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:00.843989 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:00.844463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:00.844938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:00.845574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:00.846025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:00.846477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:00.864742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:00.974568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:00.982669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:00.984099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:00.985228 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5fa36465-7580-4eae-aef9-e755d5421fb6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.152199 Sep 01 16:32:00.985759 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 82/184] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:00 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:01.167905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:01.168509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:01.174533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:01.175008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:01.175437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:01.176108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:01.176558 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:01.176976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:01.304468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:01.312018 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-53401c02-d6e1-4f93-a070-5727849857df tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.148466 Sep 01 16:32:01.312611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 103/185] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:01 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:01.460169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:01.460779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:01.467250 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:01.467728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:01.468163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:01.468850 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:01.469303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:01.469725 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:01.602638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:01.610860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-575e1ccc-ce3e-4445-a3ec-d426719bea20 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.154833 Sep 01 16:32:01.611424 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 83/186] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:01 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:02.007654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:02.008293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:02.015032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:02.015516 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:02.015950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:02.016634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:02.017085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:02.017507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:02.145708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:02.153693 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:02.155166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:02.156262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b47e1a79-bee6-4806-8c06-282a99a4009a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.152461 Sep 01 16:32:02.156815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 104/187] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:02 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:02.333072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:02.333591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:02.339842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:02.340307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:02.340732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:02.341399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:02.341845 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:02.342301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:02.473069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:02.481270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ba8a760a-b924-4937-a708-043bd59e4a91 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.152107 Sep 01 16:32:02.481839 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 84/188] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:02 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:02.631372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:02.631979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:02.638011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:02.638528 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:02.638966 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:02.639648 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:02.640106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:02.640529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:02.764655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:02.772217 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6c55868a-9fbf-4e95-b9c1-4cc5cc84c2e8 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.144622 Sep 01 16:32:02.772779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 105/189] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:02 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:03.179392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:03.180015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:03.186009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:03.186510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:03.186937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:03.187607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:03.188053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:03.188469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:03.315157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:03.323109 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:03.324534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:03.325614 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2a903e63-76b0-47cb-86eb-055b70435160 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.150116 Sep 01 16:32:03.326162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 85/190] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:03 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:03.502105 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:03.502730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:03.508635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:03.509106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:03.509529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:03.510745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:03.511192 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:03.511604 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:03.641343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:03.650184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1d40b181-cd29-417b-b957-438cebe672a6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.151870 Sep 01 16:32:03.651575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 106/191] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:03 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:03.793096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:03.793703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:03.800038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:03.800518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:03.800953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:03.801640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:03.802102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:03.802557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:03.926519 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:03.934622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-acea5722-4ca7-4580-afc6-4b6ce066cccb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.145444 Sep 01 16:32:03.935188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 86/192] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:03 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:04.348591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:04.349265 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:04.355871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:04.356532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:04.357127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:04.357818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:04.358307 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:04.358727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:04.507399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:04.515898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:04.517326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:04.518441 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-78494ebf-daf8-42e3-94fc-02b3879a12b1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.174047 Sep 01 16:32:04.519004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 107/193] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:04 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:04.671140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:04.672052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:04.678746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:04.679221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:04.679690 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:04.680350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:04.680801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:04.681219 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:04.809238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:04.816946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ec6f7c55-f1be-47a7-aa06-7ea9b55ed031 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.149655 Sep 01 16:32:04.817514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 87/194] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:04 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:04.955735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:04.956255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:04.962378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:04.962860 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:04.963933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:04.964609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:04.965056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:04.965473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:05.279961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:05.287835 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e7c0824d-1498-48e4-9328-7ef54e9e56bf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.335926 Sep 01 16:32:05.288399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 108/195] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:04 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:05.543153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:05.543678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:05.549609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:05.550096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:05.550590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:05.551277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:05.551736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:05.552162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:05.705264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:05.716296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:05.718344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:05.719555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d26ece44-18d6-47ba-ad38-9bdf3c92ef18 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.180935 Sep 01 16:32:05.720772 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 88/196] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:05 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:05.838343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:05.838944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:05.849775 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:05.850305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:05.850738 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:05.851772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:05.852278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:05.853136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:06.025723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:06.034847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-84642c0f-62b2-4475-aede-ddf9d66d96f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.200870 Sep 01 16:32:06.035854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 109/197] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:05 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:06.309898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:06.310549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:06.317762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:06.318438 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:06.318927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:06.319700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:06.320233 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:06.320727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:06.461312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:06.471550 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9da7a16f-1810-4174-8c2e-c069d0699491 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.166068 Sep 01 16:32:06.472144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 89/198] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:06 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:06.750280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:06.751045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:06.757298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:06.757771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:06.758232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:06.758918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:06.759371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:06.759858 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:06.905570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:06.913894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:06.915393 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:06.917141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-309c3789-db97-404c-b507-96dd80d95280 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.171135 Sep 01 16:32:06.917813 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 110/199] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:06 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:07.055857 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:07.056660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:07.063320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:07.064201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:07.065128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:07.066300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:07.067063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:07.068063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:07.215617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:07.223543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8ff4d2bb-fa9e-47d8-826e-9f8107f361b3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.171513 Sep 01 16:32:07.224123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 90/200] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:07 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:07.491921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:07.492663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:07.499088 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:07.499577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:07.500008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:07.500694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:07.501143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:07.501597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:07.644240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:07.653065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b82c6491-c55e-4648-b72b-e17c6e88caa5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.164901 Sep 01 16:32:07.654220 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 111/201] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:07 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:07.939450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:07.940061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:07.946938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:07.947767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:07.948276 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:07.949076 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:07.949620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:07.950131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:08.087475 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:08.096573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:08.098238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:08.099888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0d8944c0-e144-4bbb-a70d-f57fa7ac5719 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.164340 Sep 01 16:32:08.100645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 91/202] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:07 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:08.251879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:08.252483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:08.262651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:08.263844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:08.264890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:08.265823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:08.266694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:08.267512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:08.513972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:08.523749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a5446661-e0c8-4286-afac-9e74b5f56319 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.282773 Sep 01 16:32:08.524339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 112/203] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:08 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:08.675137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:08.675746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:08.681771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:08.682275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:08.682781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:08.683572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:08.684026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:08.684511 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:08.817336 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:08.826185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7be5f753-8417-41de-aa48-40a8709637eb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.154814 Sep 01 16:32:08.826930 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 92/204] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:08 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:09.130067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:09.131196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:09.138425 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.139072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.139594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.140418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.141141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.141631 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.302077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:09.310986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:09.312419 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:09.313560 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2948ad88-7219-4c7f-a045-6e90898c88ff tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.188417 Sep 01 16:32:09.314121 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 113/205] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:09 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:09.552602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:09.555790 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:09.576192 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.579775 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.580237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.580988 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.581449 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.581881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.790400 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:09.799148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b0d62436-6771-4841-9de9-d30cab4cee5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.257160 Sep 01 16:32:09.799795 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 93/206] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:09 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:09.847001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:09.847612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:09.850973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:09.855773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.856267 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.856706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:09.857400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:09.858107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:09.858378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.017434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:10.026913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e7cdedd9-dfe6-4a5c-bd36-570aeae169e4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.183612 Sep 01 16:32:10.027487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 114/207] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:09 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:10.336476 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:10.337090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:10.352501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.353010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.353855 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.354904 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.355220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.355794 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.360133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-c913ba7a-2b2c-4d0f-8488-af785c67b28b req-7240df5f-c8a4-447d-bac5-0f04fc7aeeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5bd3ba-2902-4456-a6f9-0f43241577ae", "name": "network-vif-plugged", "status": "completed", "tag": "a193b26d-37c2-41b3-a5b3-f879211927f9"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:32:10.374255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c913ba7a-2b2c-4d0f-8488-af785c67b28b req-7240df5f-c8a4-447d-bac5-0f04fc7aeeaa service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.374946 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c913ba7a-2b2c-4d0f-8488-af785c67b28b req-7240df5f-c8a4-447d-bac5-0f04fc7aeeaa service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.376383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c913ba7a-2b2c-4d0f-8488-af785c67b28b req-7240df5f-c8a4-447d-bac5-0f04fc7aeeaa service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.391322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-c913ba7a-2b2c-4d0f-8488-af785c67b28b req-7240df5f-c8a4-447d-bac5-0f04fc7aeeaa service nova] Creating event network-vif-plugged:a193b26d-37c2-41b3-a5b3-f879211927f9 for instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae on hv-cinder-85220 Sep 01 16:32:10.397466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-c913ba7a-2b2c-4d0f-8488-af785c67b28b req-7240df5f-c8a4-447d-bac5-0f04fc7aeeaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042632 Sep 01 16:32:10.398757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 115/208] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:32:10.503002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:10.511243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:10.512657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:10.513767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8aa48b42-7005-46cf-ac33-c4406ad83966 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1407 microversion: 2.20 time: 0.181244 Sep 01 16:32:10.514497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 94/209] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:10 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:10.821118 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:10.822234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:10.831199 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.832275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.832900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:10.833624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:10.834064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:10.834691 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.006007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:11.015247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8140362d-8a52-4e94-ae77-2c37dcd99f71 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.198594 Sep 01 16:32:11.016170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 116/210] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:10 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:11.049053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:11.050328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:11.057292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.058410 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.059080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.059969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.060639 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.061267 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.279638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:11.290390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b9aa721b-d19d-4a91-9558-0b7adb64b4aa tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.244078 Sep 01 16:32:11.290390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 95/211] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:11 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:11.537076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:11.537744 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:11.543810 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.544286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.544679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.545443 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.545890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.546333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.693309 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:11.701512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:11.702985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:11.704141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-edca5557-aa75-4343-8d18-b972a8f4bea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1599 microversion: 2.20 time: 0.171212 Sep 01 16:32:11.704889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 117/212] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:32:11 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:32:11.726848 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:11.727447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:11.733979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.734498 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.734940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.735633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:11.736094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:11.736521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:11.840266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-331d6190-6aa8-4b6e-891a-5734f9515c28 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117400 Sep 01 16:32:11.841509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 96/213] 10.222.0.58 () {60 vars in 1316 bytes} [Thu Sep 1 16:32:11 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:32:12.037008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:12.037701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:12.044493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:12.045056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:12.045576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:12.046401 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:12.047065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:12.047561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:12.215674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:12.235049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4d22d0ed-5679-482c-a1b5-71b8a8ea149f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.201723 Sep 01 16:32:12.237887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 118/214] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:12 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:12.310381 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:12.311596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:12.318875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:12.319309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:12.319748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:12.320453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:12.320912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:12.321470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:12.505062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:12.515474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4fdf4512-7792-4b27-9978-40327c71fbd1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.208892 Sep 01 16:32:12.516147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 97/215] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:12 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:13.155942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-285cb69e-c888-4d8c-9347-0ac5346be8e9 req-d567df8a-9bbb-4442-bd05-87b439febb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:32:13.165449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-285cb69e-c888-4d8c-9347-0ac5346be8e9 req-d567df8a-9bbb-4442-bd05-87b439febb5b service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:13.166432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-285cb69e-c888-4d8c-9347-0ac5346be8e9 req-d567df8a-9bbb-4442-bd05-87b439febb5b service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:13.166859 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-285cb69e-c888-4d8c-9347-0ac5346be8e9 req-d567df8a-9bbb-4442-bd05-87b439febb5b service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:13.178539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-285cb69e-c888-4d8c-9347-0ac5346be8e9 req-d567df8a-9bbb-4442-bd05-87b439febb5b service nova] Creating event network-changed:9934d19e-6301-4c24-8a8b-6d0bf27e8bbd for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 on hv-cinder-85220 Sep 01 16:32:13.184563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-285cb69e-c888-4d8c-9347-0ac5346be8e9 req-d567df8a-9bbb-4442-bd05-87b439febb5b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031892 Sep 01 16:32:13.188329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 119/216] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:32:13.259624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:13.260456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:13.267083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:13.267563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:13.267994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:13.268680 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:13.269131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:13.269553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:13.434148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:13.443796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-eae3ee58-0667-4404-95a5-8ffcec786c04 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.188563 Sep 01 16:32:13.445168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 98/217] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:13 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:13.537445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:13.538360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:13.545696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:13.546342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:13.547007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:13.547986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:13.548579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:13.549190 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:13.572743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:13.688577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:13.696225 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0f6bceb9-43fa-4d21-be47-930197fe2aec tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.163112 Sep 01 16:32:13.697629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 120/218] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:13 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:14.465285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:14.466539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:14.473710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:14.474581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:14.475166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:14.476015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:14.476611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:14.477242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:14.498223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:14.620048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:14.627992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-835f0929-b6be-4a83-9b83-2d5a1ba6b932 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.166934 Sep 01 16:32:14.628590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 99/219] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:14 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:14.718046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:14.718691 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:14.724900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:14.725375 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:14.725805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:14.726509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:14.726957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:14.727376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:14.855670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:14.863238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2baafa88-d86a-473d-b77a-6c1dba8d805a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.149030 Sep 01 16:32:14.863808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 121/220] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:14 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:15.649294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:15.649829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:15.656473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:15.657096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:15.657547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:15.658409 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:15.658849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:15.659469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:15.794588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:15.802394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3787e747-3a0b-43fd-831d-f5aca6b3fa8b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.156873 Sep 01 16:32:15.802974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 100/221] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:15 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:15.885045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:15.885699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:15.892076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:15.892549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:15.892974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:15.893647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:15.894087 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:15.894549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:16.040859 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:16.048610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-52fd7e6c-4ae3-41c3-9b7a-6ce896f26b7a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.168384 Sep 01 16:32:16.049180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 122/222] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:15 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:16.823574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:16.824109 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:16.830617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:16.831092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:16.831523 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:16.832202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:16.832655 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:16.833079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:16.958334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:16.966234 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-005f2ee4-57fa-4f25-85ec-acbee02e8d34 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.147109 Sep 01 16:32:16.966817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 101/223] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:16 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:17.070033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:17.070655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:17.076716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:17.077141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:17.077581 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:17.078281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:17.078726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:17.079142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:17.208134 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:17.215769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-51fa0835-f88c-4404-bd0d-598bd0f9d188 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.149556 Sep 01 16:32:17.216337 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 123/224] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:17 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:17.987715 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:17.988317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:17.994864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:17.995342 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:17.995778 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:17.996459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:17.996911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:17.997333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:18.123100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:18.130642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-49be1694-ca62-4ced-92f8-e1c80da75569 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.146744 Sep 01 16:32:18.131207 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 102/225] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:17 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:18.236670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:18.237262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:18.243240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:18.244211 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:18.244638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:18.245313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:18.245750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:18.246164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:18.374338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:18.381904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0da67f4a-77ae-4eae-b2ff-0aef4785adb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.148972 Sep 01 16:32:18.382521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 124/226] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:18 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:19.152132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:19.152731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:19.159371 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:19.159851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:19.160536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:19.161217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:19.161671 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:19.162094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:19.286440 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:19.294345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b0cab897-7458-4046-8ccc-9fab82caa257 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.146513 Sep 01 16:32:19.294916 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 103/227] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:19 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:19.404386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:19.404915 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:19.411139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:19.411610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:19.412034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:19.412701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:19.413145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:19.413558 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:19.544058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:19.551713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a91a11d8-33ec-4e42-b09f-65c92f214e8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.152219 Sep 01 16:32:19.552320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 125/228] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:19 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:20.317808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:20.318608 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:20.325139 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:20.325619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:20.326057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:20.326765 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:20.327225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:20.327648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:20.456599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:20.464789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1859b42a-bf0a-4af6-a98b-dac51010a2fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.151499 Sep 01 16:32:20.465379 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 104/229] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:20 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:20.573178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:20.573739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:20.579837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:20.580329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:20.580753 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:20.581443 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:20.581898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:20.582521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:20.718863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:20.726799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8c3dbbf1-d03f-4109-9d7c-fa7f58592fe9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.157712 Sep 01 16:32:20.727389 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 126/230] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:20 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:21.485914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:21.486563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:21.492949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:21.494050 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:21.494513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:21.495193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:21.495642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:21.496061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:21.625332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:21.632910 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-859806a7-569c-4d48-90eb-553518b1b3cb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.150817 Sep 01 16:32:21.633474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 105/231] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:21 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:21.748002 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:21.748550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:21.755021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:21.755519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:21.755956 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:21.756646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:21.757100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:21.757523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:21.885963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:21.893676 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d63dcaea-6763-49c9-91d1-cd3068a68e38 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.150290 Sep 01 16:32:21.895649 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 127/232] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:21 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:22.655771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:22.656391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:22.664042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:22.664941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:22.665707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:22.667022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:22.667583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:22.668067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:22.810742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:22.818231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-09489199-dc18-4d99-b8bd-1c46dd26a318 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.167781 Sep 01 16:32:22.818797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 106/233] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:22 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:22.914838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:22.915951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:22.921886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:22.922413 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:22.922838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:22.923518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:22.923966 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:22.924416 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:23.064734 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:23.073070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a8d329b9-4e12-413c-8e65-42a2f94570d1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.161979 Sep 01 16:32:23.073641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 128/234] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:22 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:23.838725 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:23.839364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:23.845856 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:23.846449 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:23.846890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:23.847590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:23.848042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:23.848474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:23.981023 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:23.988835 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c296da48-5b88-4b1e-b274-33bffc75c86a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.154616 Sep 01 16:32:23.989919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 107/235] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:23 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:24.105689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:24.107446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:24.114317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:24.114898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:24.115423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:24.116218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:24.116885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:24.117284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:24.262832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:24.270830 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3d0384b7-8672-49aa-a7bd-dfbabae80b2d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.181543 Sep 01 16:32:24.271411 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 129/236] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:24 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:25.010151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:25.010776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:25.026396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:25.026396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:25.026396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:25.026396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:25.026779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:25.026779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:25.214829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:25.224857 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e4aa2e19-09a8-4ad9-8d28-f904e54c83c0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.218444 Sep 01 16:32:25.227940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 108/237] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:25 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:25.291771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:25.292352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:25.298348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:25.298821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:25.299241 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:25.299923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:25.300368 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:25.300778 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:25.432129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:25.439936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-16ae2858-2fd6-4e0f-b1f0-5cfb7786ae18 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.151914 Sep 01 16:32:25.440479 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 130/238] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:25 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:26.248148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:26.248750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:26.255086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:26.255575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:26.256005 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:26.256686 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:26.257140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:26.257569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:26.391011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:26.399808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5c073cbc-31a9-42c6-a747-f457ae827d50 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.154799 Sep 01 16:32:26.400559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 109/239] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:26 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:26.461460 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:26.462603 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:26.471611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:26.472093 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:26.472520 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:26.473234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:26.473677 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:26.474090 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:26.601562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:26.609808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-89ae8f4a-fab8-4e37-a4e7-7ffff49d37de tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.152492 Sep 01 16:32:26.610412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 131/240] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:26 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:27.420762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:27.421367 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:27.427750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:27.428240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:27.428670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:27.429346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:27.429796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:27.430237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:27.561282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:27.569253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d2f84645-e6c5-4ebf-ba96-e5796b0147d5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.152287 Sep 01 16:32:27.569844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 110/241] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:27 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:27.630030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:27.630669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:27.637139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:27.637611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:27.638035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:27.638739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:27.639184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:27.639596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:27.763917 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:27.771665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1b186fd9-0ffa-446a-add6-e7dd9e6e7b3f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.145314 Sep 01 16:32:27.772239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 132/242] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:27 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:28.590605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:28.591241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:28.593563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=64 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:28.598535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:28.599022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:28.599452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:28.600141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:28.600592 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:28.601035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:28.728816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:28.736462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b42d9a24-db14-450d-a6d6-61b0961b5770 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.149723 Sep 01 16:32:28.737048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 111/243] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:28 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:28.793255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:28.793853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:28.799876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:28.800364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:28.800769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:28.801437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:28.801880 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:28.802330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:28.929741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:28.937208 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-24dc1ca6-bb0d-41f6-9c92-b3ad3b208194 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.148358 Sep 01 16:32:28.937762 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 133/244] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:28 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:29.757451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:29.758178 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:29.765220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:29.765720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:29.766145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:29.766853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:29.767304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:29.767718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:29.896644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:29.904906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-00a3590a-ccc0-4756-8884-a23b5d813a5a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.151736 Sep 01 16:32:29.905474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 112/245] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:29 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:29.957868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:29.958505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:29.965048 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:29.965523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:29.965950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:29.966659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:29.967107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:29.967533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:30.098577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:30.106349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-30aa7c9c-1f61-4a5f-9369-d732e0e32b2a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.152240 Sep 01 16:32:30.106919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 134/246] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:29 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:30.925017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:30.925623 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:30.932918 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:30.933369 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:30.933799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:30.934519 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:30.934973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:30.935394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:31.062970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:31.070742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5d0cb40e-caa0-469b-8075-ac4974ebb1fd tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.149541 Sep 01 16:32:31.071319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 113/247] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:30 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:31.127003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:31.127604 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:31.134304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:31.134793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:31.135224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:31.135907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:31.136384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:31.136814 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:31.263950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:31.271556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-151e0d00-d7d1-49ba-8341-ceaa3469d211 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.148362 Sep 01 16:32:31.272124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 135/248] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:31 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:32.091483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:32.092095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:32.098498 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:32.098980 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:32.099418 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:32.100101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:32.100558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:32.100985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:32.225846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:32.234049 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2a07b170-cb12-446e-8940-8b4f83397cf2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.146383 Sep 01 16:32:32.234647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 114/249] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:32 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:32.292753 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:32.293295 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:32.299271 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:32.299750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:32.300182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:32.300864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:32.301319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:32.301740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:32.424978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:32.432453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e858a6a8-a8d5-4bda-90e8-200e3cdd34fb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.144287 Sep 01 16:32:32.433010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 136/250] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:32 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:33.255579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:33.256182 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:33.263215 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:33.263684 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:33.264182 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:33.264941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:33.265386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:33.265805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:33.396588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:33.404259 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e5d03d62-f6f1-4d15-9c1c-7fa744269983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.152595 Sep 01 16:32:33.404854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 115/251] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:33 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:33.453138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:33.453738 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:33.459777 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:33.460246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:33.460675 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:33.461343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:33.461783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:33.462223 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:33.466106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:33.692875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:33.702311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2a6f9e58-bdb8-42f7-8443-4f2f6806e5e1 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1361 microversion: 2.1 time: 0.253122 Sep 01 16:32:33.703487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 137/252] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:33 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:34.426232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:34.426846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:34.433847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.434350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.434783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.435463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.435911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.436333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.440292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:34.566993 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:34.575208 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4dcc8933-61ca-4cac-a1bf-30bd248f7140 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.152840 Sep 01 16:32:34.575768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 116/253] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:34 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:34.723428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:34.724080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:34.730806 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.731300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.731730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.732425 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.732878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.733301 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.794926 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:34.795427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:34.801458 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.802155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.802818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.803701 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.804369 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.805028 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.833774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:32:34.882557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:34.891252 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7914086b-eb00-4ccf-be8a-bfbb236ad89b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1546 microversion: 2.1 time: 0.171634 Sep 01 16:32:34.906886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 138/254] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:34 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1546 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:34.913782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:34.914315 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:34.920326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.920803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.921226 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.921898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.922386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.922797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.934389 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a02dc1d4-2672-45b2-bd91-a675d6fcb77d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 204 len: 0 microversion: 2.1 time: 0.142870 Sep 01 16:32:34.938345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 117/255] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:32:34 2022] DELETE /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:32:34.943975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:34.944751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:34.952162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.952657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.953093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:34.953798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:34.954283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:34.954720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:35.045672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-46a080c0-c07d-46d3-9d64-c0ad87f3c6c9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135832 Sep 01 16:32:35.046312 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 139/256] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:32:34 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:32:35.112595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:35.120864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2eb73afe-7fa9-4e0b-acad-20d1b5333117 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.181340 Sep 01 16:32:35.121433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 118/257] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:34 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:35.597224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:35.597889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:35.605021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:35.605478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:35.605902 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:35.606608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:35.607053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:35.607471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:35.738380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:35.747209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-67f561cd-e262-4662-84ee-fd1149c5dbfa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.154464 Sep 01 16:32:35.747888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 140/258] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:35 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:35.997406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-9394ec68-178d-4bca-90cf-73b604d9776a req-a1a2093f-077b-49b0-8e88-90f122e0102b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a5bd3ba-2902-4456-a6f9-0f43241577ae", "tag": "a193b26d-37c2-41b3-a5b3-f879211927f9"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:32:36.007393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-9394ec68-178d-4bca-90cf-73b604d9776a req-a1a2093f-077b-49b0-8e88-90f122e0102b service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:36.007857 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-9394ec68-178d-4bca-90cf-73b604d9776a req-a1a2093f-077b-49b0-8e88-90f122e0102b service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:36.008819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-9394ec68-178d-4bca-90cf-73b604d9776a req-a1a2093f-077b-49b0-8e88-90f122e0102b service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:36.023384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-9394ec68-178d-4bca-90cf-73b604d9776a req-a1a2093f-077b-49b0-8e88-90f122e0102b service nova] Creating event network-changed:a193b26d-37c2-41b3-a5b3-f879211927f9 for instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae on hv-cinder-85220 Sep 01 16:32:36.028932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-9394ec68-178d-4bca-90cf-73b604d9776a req-a1a2093f-077b-49b0-8e88-90f122e0102b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035123 Sep 01 16:32:36.029526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 119/259] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:32:36.142250 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:36.143325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:36.149407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:36.149962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:36.150637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:36.151456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:36.151972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:36.152459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:36.285949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:36.294656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0483fd54-fdbc-49a8-8d97-9bf5a916150c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.156217 Sep 01 16:32:36.295247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 141/260] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:36 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:36.768754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:36.769359 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:36.776268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:36.776781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:36.777214 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:36.777914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:36.778513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:36.778936 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:36.911759 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:36.920473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9f769944-8c66-4155-82eb-8c89849927b8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.155895 Sep 01 16:32:36.921058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 120/261] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:36 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:37.316277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:37.316805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:37.323472 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:37.323942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:37.324366 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:37.325032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:37.325476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:37.325888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:37.449183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:37.457285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-49b09607-52ff-43ad-b9a0-12b5fcecf2be tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.144876 Sep 01 16:32:37.457845 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 142/262] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:37 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:37.941203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:37.941803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:37.948314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:37.948785 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:37.949214 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:37.949891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:37.950394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:37.950819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:38.078335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:38.086666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6f285ea4-4df3-4436-91ec-e1849a6a1899 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.148712 Sep 01 16:32:38.087232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 121/263] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:37 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:38.480059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:38.480661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:38.487436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:38.487859 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:38.488289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:38.488972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:38.489423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:38.490022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:38.620314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:38.628422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7c5df81c-c4f9-40ff-8330-c56d6ddde00c tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.153455 Sep 01 16:32:38.628979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 143/264] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:38 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:39.107216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:39.107820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:39.114540 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:39.114954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:39.115382 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:39.116061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:39.116513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:39.116930 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:39.243538 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:39.251425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fe241d64-95d4-4040-9a0c-b5e4e536b53e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.148079 Sep 01 16:32:39.252000 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 122/265] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:39 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:39.650128 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:39.650765 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:39.656788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:39.657264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:39.657693 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:39.658398 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:39.658849 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:39.659269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:39.788653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:39.797638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-fb1c9afe-2066-4ba2-bf75-6ca846940f19 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.151392 Sep 01 16:32:39.798219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 144/266] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:39 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:40.272649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:40.273162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:40.280141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:40.280611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:40.281036 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:40.281707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:40.282149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:40.282587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:40.409123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:40.417075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c18a7b1e-044f-4ba3-b353-8ba36497b331 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.148374 Sep 01 16:32:40.417638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 123/267] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:40 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:40.817984 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:40.818632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:40.821427 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=61 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:40.826968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:40.827449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:40.827881 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:40.828564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:40.829015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:40.829436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:40.960058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:40.968360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8398c5d6-3298-4d26-90b7-c4d5258808c9 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.154171 Sep 01 16:32:40.968935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 145/268] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:40 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:41.438549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:41.439156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:41.445457 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:41.445938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:41.446458 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:41.447155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:41.447611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:41.448461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:41.650837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:41.659387 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fc8fbdeb-6b77-43ed-a9a2-1314e10524c8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.224781 Sep 01 16:32:41.660418 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 124/269] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:41 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:41.989979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:41.990616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:41.996992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:41.997474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:41.997905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:41.998619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:41.999069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:41.999486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:42.187608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:42.195740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5912a9e7-7d42-4cb2-940f-cbae9bc658fd tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.209629 Sep 01 16:32:42.196295 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 146/270] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:41 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:42.680694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:42.681298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:42.689230 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:42.689708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:42.690137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:42.690858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:42.691370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:42.691792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:42.831211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:42.839318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-044b373b-860f-4188-b821-265c88afcdbb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.161960 Sep 01 16:32:42.839889 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 125/271] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:42 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:43.217076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:43.217782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:43.223732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:43.224206 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:43.224639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:43.225318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:43.225769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:43.226209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:43.382286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:43.390585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3a1dcd65-087b-4506-9472-ada616f0795d tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.177433 Sep 01 16:32:43.391151 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 147/272] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:43 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:43.860190 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:43.860795 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:43.870847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:43.871689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:43.872363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:43.873478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:43.873942 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:43.874476 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:44.006486 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:44.015238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c12eb114-f4e0-4158-9dd6-5e31a5414f72 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.158939 Sep 01 16:32:44.015889 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 126/273] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:43 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:44.411140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:44.411730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:44.417731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:44.419398 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:44.419847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:44.420970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:44.421466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:44.421924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:44.552340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:44.561086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-02b7c8ae-5d2d-45df-ac12-613ddb1a1d51 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.153971 Sep 01 16:32:44.561780 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 148/274] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:44 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:45.037660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:45.038276 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:45.045351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:45.045824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:45.046281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:45.046963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:45.047408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:45.047826 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:45.176199 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:45.183782 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-22753a62-b166-4ded-864b-d7e97081f2f9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.150207 Sep 01 16:32:45.184341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 127/275] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:45 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:45.583056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:45.583659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:45.590146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:45.590662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:45.591091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:45.591770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:45.592217 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:45.592637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:45.719008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:45.728267 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-31c01ac1-81ff-4228-9427-0311d0c93e0f tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.149173 Sep 01 16:32:45.729145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 149/276] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:45 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:46.204709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:46.205239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:46.211704 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:46.212186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:46.212622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:46.213329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:46.213804 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:46.214284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:46.353238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:46.361474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fbbab4b3-5fc8-4425-a862-2079745ad244 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.160773 Sep 01 16:32:46.362159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 128/277] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:46 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:46.749856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:46.750506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:46.756504 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:46.756981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:46.757413 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:46.758092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:46.758571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:46.758993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:46.884965 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:46.893636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cd17aa16-31d8-481c-ae77-dc41c034fb07 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.147574 Sep 01 16:32:46.894230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 150/278] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:46 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:47.382941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:47.383546 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:47.390695 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:47.391166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:47.391696 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:47.392369 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:47.392819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:47.393233 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:47.520044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:47.527586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3e0bfa66-6be0-4074-af6a-6e39d741e063 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.148460 Sep 01 16:32:47.528149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 129/279] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:47 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:47.915315 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:47.915928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:47.922449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:47.922938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:47.923377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:47.924059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:47.924511 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:47.924935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:48.050496 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:48.058930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e1846dd8-4684-4879-ab1a-f8f5a0bbc0fa tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.147519 Sep 01 16:32:48.059500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 151/280] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:47 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:48.550136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:48.551025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:48.563508 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:48.564081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:48.564609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:48.565534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:48.566057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:48.566742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:48.716468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:48.725348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fcfe4999-5602-4de1-ab1f-9ade3bba7f9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.179303 Sep 01 16:32:48.726013 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 130/281] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:48 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:49.080287 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:49.081383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:49.087091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:49.087567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:49.088000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:49.088681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:49.089771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:49.090220 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:49.307479 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:49.315594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-abbf488a-7769-45e7-bf08-c0e5f9c44406 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1553 microversion: 2.1 time: 0.239150 Sep 01 16:32:49.316451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 152/282] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:49 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:49.447202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-373537c8-c6c3-42bd-8874-aa09aa6ed399 req-c44f3031-bfad-4540-85b0-7c4f9cec7f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c5391a-25a4-447a-841c-20fc410cc636", "name": "network-vif-deleted", "tag": "7865488d-a0aa-4d46-a70c-266fbc62a9a4"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:32:49.457662 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-373537c8-c6c3-42bd-8874-aa09aa6ed399 req-c44f3031-bfad-4540-85b0-7c4f9cec7f2c service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:49.458136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-373537c8-c6c3-42bd-8874-aa09aa6ed399 req-c44f3031-bfad-4540-85b0-7c4f9cec7f2c service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:49.458597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-373537c8-c6c3-42bd-8874-aa09aa6ed399 req-c44f3031-bfad-4540-85b0-7c4f9cec7f2c service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:49.470223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-373537c8-c6c3-42bd-8874-aa09aa6ed399 req-c44f3031-bfad-4540-85b0-7c4f9cec7f2c service nova] Creating event network-vif-deleted:7865488d-a0aa-4d46-a70c-266fbc62a9a4 for instance b4c5391a-25a4-447a-841c-20fc410cc636 on hv-cinder-85220 Sep 01 16:32:49.475450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-373537c8-c6c3-42bd-8874-aa09aa6ed399 req-c44f3031-bfad-4540-85b0-7c4f9cec7f2c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032000 Sep 01 16:32:49.476236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 131/283] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:32:49.747733 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:49.748336 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:49.754312 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:49.754791 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:49.755220 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:49.755894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:49.756372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:49.756790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:50.085401 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:50.096852 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-75041499-cf51-46b8-85a6-326c17497c3a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.354144 Sep 01 16:32:50.097730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 153/284] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:49 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:32:50.338094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:50.339566 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:50.345672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:50.346321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:50.346758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:50.347453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:50.347907 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:50.348357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:50.368973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:50.418484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:50.426664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-75195880-b888-4cc3-9a9e-76205cc2b569 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1511 microversion: 2.1 time: 0.093558 Sep 01 16:32:50.427237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 132/285] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:50 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1511 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:51.116888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:51.117428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:51.123952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:51.124426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:51.124856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:51.125530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:51.125994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:51.126555 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:51.130483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:32:51.260325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:51.270412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c32bff75-705a-445f-87e0-bb091298961d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.157005 Sep 01 16:32:51.271216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 154/286] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:51 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:51.447334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:51.447939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:51.454403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:51.454884 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:51.455318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:51.456002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:51.456460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:51.456882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:51.519107 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:51.527572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7682343d-e0c4-4f42-87f5-8d468f67e760 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1511 microversion: 2.1 time: 0.084045 Sep 01 16:32:51.528150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 133/287] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:51 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1511 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:52.297090 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:52.297690 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:52.303580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:52.304054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:52.304487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:52.305192 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:52.305643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:52.306058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:52.444302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:52.452473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2212c2c3-104b-4717-bbd2-c7bad1dd7f58 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.159320 Sep 01 16:32:52.453046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 155/288] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:52 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:52.551289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:52.551837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:52.558169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:52.558678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:52.559106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:52.560290 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:52.560290 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:52.560637 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:52.765411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:52.774407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c4d177b5-2199-40a7-8a79-a118032ea5b1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1345 microversion: 2.1 time: 0.228244 Sep 01 16:32:52.782238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 134/289] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:52 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1345 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:53.473967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:53.474628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:53.480520 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:53.480994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:53.481422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:53.482104 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:53.482608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:53.483028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:53.625741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:53.633876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f5d60938-1e4c-499d-87a2-afc4a4643d9e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1522 microversion: 2.1 time: 0.163664 Sep 01 16:32:53.634466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 156/290] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:53 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:53.796873 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:53.797689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:53.804308 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:53.804897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:53.805422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:53.806172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:53.806854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:53.807373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:53.839657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:53.840276 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:53.840807 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:53.841460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lazy-loading 'fault' on Instance uuid b4c5391a-25a4-447a-841c-20fc410cc636 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:32:53.891827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69ac454b5a64e6d83188ad2b8e107d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19bb3b3c67024a7bbe30ba1b59e7f50a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:53.900472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f01ab64a-ecf8-4991-a412-7c02c735836b tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 200 len: 1350 microversion: 2.1 time: 0.107670 Sep 01 16:32:53.901046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 135/291] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:53 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:54.655488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:54.656093 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:54.662422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:54.662902 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:54.663335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:54.664016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:54.664470 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:54.664947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:54.803846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:54.812053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-514da30a-f27a-4845-92e3-b781ac399caa tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1502 microversion: 2.1 time: 0.160990 Sep 01 16:32:54.812830 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 157/292] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:54 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:54.832070 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:54.832667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:54.839478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:54.839946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:54.840420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:54.841144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:54.841580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:54.841997 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:54.923487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:54.923995 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:54.930073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:54.930594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:54.931026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:54.931712 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:54.932167 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:54.933084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:54.981413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:54.989842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-99735885-91dd-4000-b96d-ce32f936bdb6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1516 microversion: 2.1 time: 0.161411 Sep 01 16:32:54.990472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 136/293] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:54 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:55.094536 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] HTTP exception thrown: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Request method failure captured: Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 HTTP/1.1 Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5IcOyXsgC36NXAfo9eMoaLQxrjVxM5SCbw2cu2aBXCUPZrmgbB2MR9xk6da0JVFtZGyMzbAI3aJsCnOurIezv2J1IX8VP0wzjFxZIlWXUEwLQ2Hu7fKOuF02pTaxq8rpfnZgL65EwChO9jP8Cc552uZemGE9XKJxQpq4tRAGdqkDE Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:32:55.095527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_19bb3b3c67024a7bbe30ba1b59e7f50a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}] Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: f69ac454b5a64e6d83188ad2b8e107d4 Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.096841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'b4c5391a-25a4-447a-841c-20fc410cc636'} Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:32:55.098230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.099602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.101721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Returning 404 to user: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:32:55.101721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e040e11f-8b18-4e61-9502-4da7e38637f1 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 404 len: 111 microversion: 2.1 time: 0.178758 Sep 01 16:32:55.101721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 158/294] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:54 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:32:55.349522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:55.351859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:55.358578 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:55.359063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:55.360077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:55.360201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:55.360785 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:55.361137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:55.375834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] HTTP exception thrown: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Request method failure captured: Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636/os-volume_attachments HTTP/1.1 Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5IcOyXsgC36NXAfo9eMoaLQxrjVxM5SCbw2cu2aBXCUPZrmgbB2MR9xk6da0JVFtZGyMzbAI3aJsCnOurIezv2J1IX8VP0wzjFxZIlWXUEwLQ2Hu7fKOuF02pTaxq8rpfnZgL65EwChO9jP8Cc552uZemGE9XKJxQpq4tRAGdqkDE Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:32:55.382627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_19bb3b3c67024a7bbe30ba1b59e7f50a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}] Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: f69ac454b5a64e6d83188ad2b8e107d4 Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.384045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'server_id': 'b4c5391a-25a4-447a-841c-20fc410cc636'} Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:32:55.384894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:55.386172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:32:55.387562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Returning 404 to user: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:32:55.387562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b555229f-df4a-463d-8912-e77ec483ecb2 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038852 Sep 01 16:32:55.387562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 137/295] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:32:55 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:32:57.454488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:32:57.456802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:57.462933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.463516 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.464526 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.465212 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.465662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.466082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.488488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'flavor' on Instance uuid f7351def-25a9-4fd3-ab43-54ae606aa063 {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:32:57.559819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ea096f0e-c6a7-4795-93df-701e8a2a6438 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/action" status: 200 len: 32 microversion: 2.1 time: 0.109218 Sep 01 16:32:57.560359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 159/296] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:32:57 2022] POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:32:57.569922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:57.570565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:57.578577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.579060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.579496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.580193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.580674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.581066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.662406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:57.662988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:57.669595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.670080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.670546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.671248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.671706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.672131 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.687489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] HTTP exception thrown: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Request method failure captured: Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 HTTP/1.1 Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5IcOyXsgC36NXAfo9eMoaLQxrjVxM5SCbw2cu2aBXCUPZrmgbB2MR9xk6da0JVFtZGyMzbAI3aJsCnOurIezv2J1IX8VP0wzjFxZIlWXUEwLQ2Hu7fKOuF02pTaxq8rpfnZgL65EwChO9jP8Cc552uZemGE9XKJxQpq4tRAGdqkDE Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:32:57.689186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_19bb3b3c67024a7bbe30ba1b59e7f50a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}] Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: f69ac454b5a64e6d83188ad2b8e107d4 Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.690596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'b4c5391a-25a4-447a-841c-20fc410cc636'} Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:32:57.691519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.693326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.695111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Returning 404 to user: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:32:57.695111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2c0f6f8c-f40d-4e60-a298-4f2ff7908bf7 tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 404 len: 111 microversion: 2.1 time: 0.032869 Sep 01 16:32:57.695111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 160/297] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:32:57 2022] DELETE /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:32:57.702874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:57.703665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] [instance: b4c5391a-25a4-447a-841c-20fc410cc636] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:57.710107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.710706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.711209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.711905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:57.712370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:57.712782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:57.730289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] HTTP exception thrown: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Request method failure captured: Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 HTTP/1.1 Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5IcOyXsgC36NXAfo9eMoaLQxrjVxM5SCbw2cu2aBXCUPZrmgbB2MR9xk6da0JVFtZGyMzbAI3aJsCnOurIezv2J1IX8VP0wzjFxZIlWXUEwLQ2Hu7fKOuF02pTaxq8rpfnZgL65EwChO9jP8Cc552uZemGE9XKJxQpq4tRAGdqkDE Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:32:57.732107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_19bb3b3c67024a7bbe30ba1b59e7f50a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/19bb3b3c67024a7bbe30ba1b59e7f50a"}]}] Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 19bb3b3c67024a7bbe30ba1b59e7f50a Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-DeleteServersTestJSON-63745937 Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: f69ac454b5a64e6d83188ad2b8e107d4 Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-DeleteServersTestJSON-63745937-project Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.733685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'b4c5391a-25a4-447a-841c-20fc410cc636'} Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:32:57.734575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. Sep 01 16:32:57.735749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:32:57.736727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] Returning 404 to user: Instance b4c5391a-25a4-447a-841c-20fc410cc636 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:32:57.736727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1b295e5c-18b3-46b1-b020-e448ced6e0bf tempest-DeleteServersTestJSON-63745937 tempest-DeleteServersTestJSON-63745937-project] 10.222.0.58 "GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636" status: 404 len: 111 microversion: 2.1 time: 0.038015 Sep 01 16:32:57.736727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 161/298] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:57 2022] GET /compute/v2.1/servers/b4c5391a-25a4-447a-841c-20fc410cc636 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:32:57.811771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:57.821700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bd8a78bb-5dad-4529-bd2f-34d76d87ddf6 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.255155 Sep 01 16:32:57.822261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 138/299] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:57 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:32:58.843177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:32:58.843775 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:32:58.849717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:58.850209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:58.850645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:58.851328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:32:58.851772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:32:58.852185 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:32:58.987999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:32:58.999705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-180d4072-1323-4434-b038-f4f6be5dec23 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.160855 Sep 01 16:32:59.000293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 162/300] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:32:58 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:00.021009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:00.021611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:00.024166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:00.030656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:00.031136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:00.031565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:00.032255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:00.032700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:00.033299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:00.171138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:00.178881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-33361011-5b98-4d3b-9ea9-eb6b4df414cc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.161816 Sep 01 16:33:00.179450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 139/301] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:00 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:01.201781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:01.203613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:01.211958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:01.213141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:01.213726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:01.214999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:01.215734 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:01.216239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:01.408638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:01.418270 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7c157b3e-15fe-461e-a686-0f8674bb91af tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.221464 Sep 01 16:33:01.427183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 163/302] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:01 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:02.438930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:02.439536 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:02.445250 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:02.445724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:02.446156 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:02.446865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:02.447325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:02.448286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:02.503607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6b1cf995-ff0e-46b5-ae0d-f47affce581f tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Action: 'create', calling method: .version_select at 0x7f6c9d00d430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-297610398"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:02.579952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:02.588171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7299a015-f8bf-418b-8dd9-102a91098c57 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.153089 Sep 01 16:33:02.588819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 164/303] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:02 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:02.785021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6b1cf995-ff0e-46b5-ae0d-f47affce581f tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.395028 Sep 01 16:33:02.785651 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 140/304] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Sep 1 16:33:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 16:33:02.799049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b144001f-eb6c-40ad-898d-8ab7777b812a tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf11550>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:02.847514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b144001f-eb6c-40ad-898d-8ab7777b812a tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 200 len: 344 microversion: 2.1 time: 0.052780 Sep 01 16:33:02.848081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 165/305] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:02 2022] GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:03.609180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:03.609777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:03.616506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:03.616984 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:03.617412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:03.618087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:03.618638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:03.619089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:03.745889 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:03.753465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5cec5dad-d708-428e-9dc9-1a1ba8a02df3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.148750 Sep 01 16:33:03.754027 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 141/306] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:03 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:03.862388 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b71d7bd1-9d9a-4937-805c-0db2f19c9d95 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf058b0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:03.907554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b71d7bd1-9d9a-4937-805c-0db2f19c9d95 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 200 len: 344 microversion: 2.1 time: 0.049063 Sep 01 16:33:03.908100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 166/307] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:03 2022] GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:04.774483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:04.775087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:04.781595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:04.782068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:04.782526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:04.783208 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:04.783659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:04.784341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:04.910090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:04.918858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ce526aa0-f457-4fe1-a71a-2a0f792e2a78 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.148373 Sep 01 16:33:04.919425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 142/308] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:04 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:04.921343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8eb723ea-22db-4e34-94b1-f5c19a9afc9f tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf6a790>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:04.968908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8eb723ea-22db-4e34-94b1-f5c19a9afc9f tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 200 len: 345 microversion: 2.1 time: 0.051312 Sep 01 16:33:04.969461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 167/309] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:04 2022] GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:04.982496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-854cc14e-bf94-4019-a8e6-36196b89b1a4 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Action: 'create', calling method: .version_select at 0x7f6c9cf525e0>, body: {"snapshot": {"volume_id": "9d46142d-8e79-418a-9806-b53af6a301af", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1687777771"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:05.127266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-854cc14e-bf94-4019-a8e6-36196b89b1a4 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.149210 Sep 01 16:33:05.127933 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 143/310] 10.222.0.58 () {60 vars in 1162 bytes} [Thu Sep 1 16:33:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:05.138392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f6eea074-c8c0-4c60-bb80-d60b09aad58c tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf11ca0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:05.169408 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f6eea074-c8c0-4c60-bb80-d60b09aad58c tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.034657 Sep 01 16:33:05.169992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 168/311] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:05 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:05.180583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a8be6d08-552c-40ae-9fb5-136c67172bb1 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9d00d940>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:05.211913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a8be6d08-552c-40ae-9fb5-136c67172bb1 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034423 Sep 01 16:33:05.212532 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 144/312] 10.222.0.58 () {58 vars in 1140 bytes} [Thu Sep 1 16:33:05 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:05.223714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-21d6b434-1e8b-4952-8399-0673a002938a tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9d053af0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:05.252904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-21d6b434-1e8b-4952-8399-0673a002938a tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.033013 Sep 01 16:33:05.253450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 169/313] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:05 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:05.940452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:05.941558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:05.947547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:05.948614 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:05.949043 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:05.949719 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:05.950166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:05.950608 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:06.080247 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:06.087933 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9abc6adc-c7fa-40c5-8119-71843d673867 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.151998 Sep 01 16:33:06.088513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 145/314] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:05 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:06.265539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2ffef5a2-773a-4ba5-8661-973cdf24f9be tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf05430>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:06.294967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2ffef5a2-773a-4ba5-8661-973cdf24f9be tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.033202 Sep 01 16:33:06.295520 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 170/315] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:06 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:07.108598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:07.109198 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:07.115556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:07.116032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:07.116462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:07.117140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:07.117598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:07.118010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:07.243911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:07.251589 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b7113054-0fe7-40db-ac8a-874ef3481098 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.146876 Sep 01 16:33:07.252156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 146/316] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:07 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:07.307525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-fb22f094-03b5-4005-9789-57669737fe7a tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9da41430>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:07.337232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-fb22f094-03b5-4005-9789-57669737fe7a tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.033809 Sep 01 16:33:07.337781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 171/317] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:07 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:08.272506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:08.273115 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:08.279499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:08.279976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:08.280408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:08.281093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:08.281548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:08.281971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:08.350642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b3c8c534-08a7-4e30-aa91-9c137e25d423 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf05670>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:08.380311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b3c8c534-08a7-4e30-aa91-9c137e25d423 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.033701 Sep 01 16:33:08.381165 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 172/318] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:08 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:08.412764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:08.420575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6f86251d-c05f-4af2-ad59-110ac25a0d1d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.151912 Sep 01 16:33:08.421143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 147/319] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:08 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:09.392732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94517309-41d8-4242-bc37-4a21a26da28b tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf05160>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:09.421623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-94517309-41d8-4242-bc37-4a21a26da28b tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.032746 Sep 01 16:33:09.422160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 173/320] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:09 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:09.440633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:09.441269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:09.448174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:09.448652 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:09.449083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:09.449768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:09.450243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:09.450675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:09.585319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:09.594033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2fcb49bc-070f-4ea8-b8a5-11afce76d983 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.157176 Sep 01 16:33:09.594628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 148/321] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:09 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:10.434431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-20ce8e52-c0bf-43d0-98ae-7a98c4ab85dd tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf11310>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:10.463736 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-20ce8e52-c0bf-43d0-98ae-7a98c4ab85dd tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 288 microversion: 2.1 time: 0.033117 Sep 01 16:33:10.464290 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 174/322] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:10 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:10.475182 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1b77c9d7-8910-4b8b-9f31-8fa86c949019 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf5d160>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:10.534760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1b77c9d7-8910-4b8b-9f31-8fa86c949019 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 202 len: 0 microversion: 2.1 time: 0.063273 Sep 01 16:33:10.535326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 149/323] 10.222.0.58 () {58 vars in 1254 bytes} [Thu Sep 1 16:33:10 2022] DELETE /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:33:10.544114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c510faf2-81e5-4db8-bf13-fd981ca9a095 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf11ca0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:10.573193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c510faf2-81e5-4db8-bf13-fd981ca9a095 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 200 len: 287 microversion: 2.1 time: 0.033417 Sep 01 16:33:10.573785 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 175/324] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:10 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:10.615624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:10.616248 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:10.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:10.623181 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:10.623628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:10.624295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:10.624744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:10.625164 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:10.752021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:10.759682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7fc11355-3e08-4f6c-b5ac-8e5aa43588d3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.147857 Sep 01 16:33:10.760404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 150/325] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:10 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:11.586923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cea4d219-cfa0-46f5-96ab-39aedb9ffe42 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf11820>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:11.612844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-cea4d219-cfa0-46f5-96ab-39aedb9ffe42 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] HTTP exception thrown: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cea4d219-cfa0-46f5-96ab-39aedb9ffe42 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Request method failure captured: Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe HTTP/1.1 Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN6-0l9M-r6bARqv_fNh70Zn-3w4CFpH9C6s1knbB7lYWDFDtvAR-RLLh68qwX38E77PkD7j3BdglbtHthCArLl7v362yQe3t1gEovgy92b9gcaaJi0XUgVxhVKEVhx9RdZzyWqJIZsI9Iv7glrlu2YdaMipjGDCbrxE-3zj_OWzKl0 Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:33:11.615041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3dcbfb9669934bbcaaceb6f43dd44f5e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}] Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: d3aa5a36fc084259b48466cd893e036c Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'eae25bbe-7d05-4aab-83ee-669785088fbe'} Sep 01 16:33:11.616575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. (HTTP 404) (Request-ID: req-2d43ba4e-c171-4fb1-b200-268731a56562) Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.617793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:11.619098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 16:33:11.621260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cea4d219-cfa0-46f5-96ab-39aedb9ffe42 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Returning 404 to user: Snapshot eae25bbe-7d05-4aab-83ee-669785088fbe could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cea4d219-cfa0-46f5-96ab-39aedb9ffe42 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe" status: 404 len: 111 microversion: 2.1 time: 0.034438 Sep 01 16:33:11.622707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 176/326] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Sep 1 16:33:11 2022] GET /compute/v2.1/os-snapshots/eae25bbe-7d05-4aab-83ee-669785088fbe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:33:11.625456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f6794634-b85e-4a49-8bfb-ff129feb8eca tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf5d0d0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:11.691865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f6794634-b85e-4a49-8bfb-ff129feb8eca tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 202 len: 0 microversion: 2.1 time: 0.070057 Sep 01 16:33:11.692440 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 151/327] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:33:11 2022] DELETE /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:33:11.700822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cc190044-1150-4c50-8202-fabeebc99c90 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf05160>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:11.748165 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cc190044-1150-4c50-8202-fabeebc99c90 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 200 len: 344 microversion: 2.1 time: 0.051292 Sep 01 16:33:11.748730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 177/328] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:11 2022] GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:11.781918 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:11.782565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:11.791622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:11.792106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:11.792548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:11.793246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:11.793702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:11.794128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:11.933135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:11.940793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c805bfe8-a085-435c-8268-ed8974cdb7a3 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.163501 Sep 01 16:33:11.941377 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 152/329] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:11 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:12.758860 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=39 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.759611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:12.763980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ccb8d5f5-db01-493b-8c56-f400d56b0de6 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9d12e0d0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:12.793432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-ccb8d5f5-db01-493b-8c56-f400d56b0de6 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] HTTP exception thrown: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ccb8d5f5-db01-493b-8c56-f400d56b0de6 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Request method failure captured: Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af HTTP/1.1 Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN6-0l9M-r6bARqv_fNh70Zn-3w4CFpH9C6s1knbB7lYWDFDtvAR-RLLh68qwX38E77PkD7j3BdglbtHthCArLl7v362yQe3t1gEovgy92b9gcaaJi0XUgVxhVKEVhx9RdZzyWqJIZsI9Iv7glrlu2YdaMipjGDCbrxE-3zj_OWzKl0 Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:33:12.795407 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3dcbfb9669934bbcaaceb6f43dd44f5e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}] Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: d3aa5a36fc084259b48466cd893e036c Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '9d46142d-8e79-418a-9806-b53af6a301af'} Sep 01 16:33:12.796882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. (HTTP 404) (Request-ID: req-e7bef866-4c49-4e83-8ce0-96fe184d7025) Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.797794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:12.799116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:33:12.800451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ccb8d5f5-db01-493b-8c56-f400d56b0de6 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Returning 404 to user: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ccb8d5f5-db01-493b-8c56-f400d56b0de6 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 404 len: 109 microversion: 2.1 time: 0.038817 Sep 01 16:33:12.801871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 178/330] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:12 2022] GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:33:12.811501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8418444a-8906-4a80-8143-78fbed043d82 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9d0bf790>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:12.839577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-8418444a-8906-4a80-8143-78fbed043d82 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] HTTP exception thrown: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8418444a-8906-4a80-8143-78fbed043d82 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Request method failure captured: Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af HTTP/1.1 Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN6-0l9M-r6bARqv_fNh70Zn-3w4CFpH9C6s1knbB7lYWDFDtvAR-RLLh68qwX38E77PkD7j3BdglbtHthCArLl7v362yQe3t1gEovgy92b9gcaaJi0XUgVxhVKEVhx9RdZzyWqJIZsI9Iv7glrlu2YdaMipjGDCbrxE-3zj_OWzKl0 Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:33:12.842966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3dcbfb9669934bbcaaceb6f43dd44f5e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}] Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: d3aa5a36fc084259b48466cd893e036c Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '9d46142d-8e79-418a-9806-b53af6a301af'} Sep 01 16:33:12.844461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. (HTTP 404) (Request-ID: req-20eb933e-66cd-4244-afb2-c3accb8b3e2c) Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.845201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:33:12.846431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:33:12.847742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8418444a-8906-4a80-8143-78fbed043d82 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Returning 404 to user: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8418444a-8906-4a80-8143-78fbed043d82 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 404 len: 109 microversion: 2.1 time: 0.037091 Sep 01 16:33:12.849156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 153/331] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:33:12 2022] DELETE /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:33:12.854952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e77d7d24-617a-4fc3-95e8-491ff3b0b005 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Calling method '.version_select at 0x7f6c9cf05310>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:12.882261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-e77d7d24-617a-4fc3-95e8-491ff3b0b005 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] HTTP exception thrown: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e77d7d24-617a-4fc3-95e8-491ff3b0b005 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Request method failure captured: Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af HTTP/1.1 Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN6-0l9M-r6bARqv_fNh70Zn-3w4CFpH9C6s1knbB7lYWDFDtvAR-RLLh68qwX38E77PkD7j3BdglbtHthCArLl7v362yQe3t1gEovgy92b9gcaaJi0XUgVxhVKEVhx9RdZzyWqJIZsI9Iv7glrlu2YdaMipjGDCbrxE-3zj_OWzKl0 Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:33:12.884144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3dcbfb9669934bbcaaceb6f43dd44f5e", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3dcbfb9669934bbcaaceb6f43dd44f5e"}]}] Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 3dcbfb9669934bbcaaceb6f43dd44f5e Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-421654133 Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: d3aa5a36fc084259b48466cd893e036c Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesSnapshotsTestJSON-421654133-project Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '9d46142d-8e79-418a-9806-b53af6a301af'} Sep 01 16:33:12.885624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. (HTTP 404) (Request-ID: req-dfb0e7b0-8a1f-49a9-baa2-8fdadda8c4b0) Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.886507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:33:12.887532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:33:12.888546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e77d7d24-617a-4fc3-95e8-491ff3b0b005 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] Returning 404 to user: Volume 9d46142d-8e79-418a-9806-b53af6a301af could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e77d7d24-617a-4fc3-95e8-491ff3b0b005 tempest-VolumesSnapshotsTestJSON-421654133 tempest-VolumesSnapshotsTestJSON-421654133-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af" status: 404 len: 109 microversion: 2.1 time: 0.035257 Sep 01 16:33:12.889567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 179/332] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:33:12 2022] GET /compute/v2.1/os-volumes/9d46142d-8e79-418a-9806-b53af6a301af => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:33:12.964388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:12.965103 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:12.972025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:12.972509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:12.972951 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:12.973649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:12.974108 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:12.974558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:13.105960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:13.113847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2e3ec9f5-f7af-439e-916d-9d2f9484fe14 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.154587 Sep 01 16:33:13.114667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 154/333] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:12 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:14.134868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:14.136098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:14.142004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:14.142534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:14.142969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:14.143659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:14.144146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:14.144576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:14.284221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:14.292664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-77ab8e38-1376-48b8-bf63-a1ab914ffed7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.161616 Sep 01 16:33:14.293227 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 180/334] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:14 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:15.313613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:15.314271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:15.321616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.322112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.322607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.323317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:15.323769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:15.324195 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:15.346497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:15.464853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:15.473135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bdb8ea90-2daf-4224-8cef-29ad7f0cef41 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.163253 Sep 01 16:33:15.473856 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 155/335] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:15 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:16.495517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:16.496216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.503085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.503767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.504359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.505222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.505825 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.506440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.650164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:16.657883 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-930602b4-3e55-4bba-b4d6-e1a56c3fd41e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1502 microversion: 2.1 time: 0.166740 Sep 01 16:33:16.658985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 181/336] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:16 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:16.678742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0baf40c8-173a-4009-96ef-90de1758e897"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:16.681170 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.688560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.689046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.689480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.690173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.690643 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.691248 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.717417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] HTTP exception thrown: Cannot 'attach_volume' instance f7351def-25a9-4fd3-ab43-54ae606aa063 while it is in vm_state rescued Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Request method failure captured: Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/os-volume_attachments HTTP/1.1 Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 74 Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5DhGwDvyeVYc1b1IRUjRSH1q6wiRcRqynKksMmmqN4a0CDpF-DZJUtA397BYhFRVZDDgXGvKv5TMTx_L_gv3r_F-P6lFOlhj86IlezydJtu1s-5ElqC0X68Scv7oT5qVe69kHSH-rHyvQ7hkfYxORBgn8nS4FY-phTfpn2VI8Ao8c Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:33:16.719143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27cd65c8d8044dddaf7a761697d216b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}] Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 0d4f8f3a6d42456d8e5cfbe20e54687a Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {"volumeAttachment": {"volumeId": "0baf40c8-173a-4009-96ef-90de1758e897"}} Sep 01 16:33:16.720708 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Cannot 'attach_volume' instance f7351def-25a9-4fd3-ab43-54ae606aa063 while it is in vm_state rescued Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'server_id': 'f7351def-25a9-4fd3-ab43-54ae606aa063', 'body': {'volumeAttachment': {'volumeId': '0baf40c8-173a-4009-96ef-90de1758e897'}}} Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:33:16.721425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f7351def-25a9-4fd3-ab43-54ae606aa063 while it is in vm_state rescued Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:33:16.722626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f7351def-25a9-4fd3-ab43-54ae606aa063 while it is in vm_state rescued Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Returning 409 to user: Cannot 'attach_volume' instance f7351def-25a9-4fd3-ab43-54ae606aa063 while it is in vm_state rescued {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-73add281-878f-4458-82a7-929038e46033 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045840 Sep 01 16:33:16.724151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 156/337] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:33:16 2022] POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:33:16.730980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:16.731564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.738541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.739022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.739452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.740135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.740574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.741092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.816824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ba2f6c0e-a9f2-4754-adce-ed1f2fe8d1ab tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/action" status: 202 len: 0 microversion: 2.1 time: 0.090549 Sep 01 16:33:16.817530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 182/338] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:33:16 2022] POST /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:33:16.826217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:16.826836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:16.832825 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.833547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.834174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:16.835596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:16.836238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:16.836834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:17.005058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:17.014888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-12e9290f-f4c4-4639-9ad5-78ede3248953 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1510 microversion: 2.1 time: 0.193137 Sep 01 16:33:17.015494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 157/339] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:16 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1510 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:18.037467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:18.038181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:18.046568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.047434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.047865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.049063 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:18.049756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:18.050462 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:18.191616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:18.200032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-caeacf97-f795-421f-8727-c6785bf358b7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1510 microversion: 2.1 time: 0.167605 Sep 01 16:33:18.200755 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 183/340] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:18 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:19.222321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:19.222981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:19.229528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.230020 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.230493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.231210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:19.231639 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:19.232199 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:19.366618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:19.374524 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b7c7565d-1f69-4ec9-93ab-3bbcc98e958c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1510 microversion: 2.1 time: 0.156122 Sep 01 16:33:19.375444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 158/341] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:19 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:20.396372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:20.396887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:20.403384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:20.403857 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:20.404285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:20.404953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:20.405396 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:20.405808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:20.537951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:20.546127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cb5ca811-a3fc-442f-b183-7014d74b8d92 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1510 microversion: 2.1 time: 0.153696 Sep 01 16:33:20.546782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 184/342] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:20 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:21.566996 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:21.567709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:21.574928 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.575412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.575843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.576528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:21.577142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:21.577572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:21.756003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:21.764489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-df1aeed2-70a7-4bbe-8354-7302aaa3237a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1516 microversion: 2.1 time: 0.201284 Sep 01 16:33:21.765061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 159/343] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:21 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:24.187692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-91b51c05-312e-472d-9c09-5e7b442f26a1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'create', calling method: .version_select at 0x7f6c9cf6af70>, body: {"keypair": {"name": "tempest-keypair-252816646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjvIQAaStRYBLdDUSiC0JkA17fXcoJn0z3MaSZVp/c1Lt8Vql68875DgYu4zPM5xdCF6tm1gBUXHUo837pXsaKt0Qe44kTLNteLCaBG3cd0wMLFVqVWyin21lahuEgeXg=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:24.204188 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-91b51c05-312e-472d-9c09-5e7b442f26a1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:24.208295 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-91b51c05-312e-472d-9c09-5e7b442f26a1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for user 0d4f8f3a6d42456d8e5cfbe20e54687a and project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:24.229947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-91b51c05-312e-472d-9c09-5e7b442f26a1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046051 Sep 01 16:33:24.230817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 185/344] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:33:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:25.551595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1835420775", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89dca715-3b69-4c8b-b0a5-998f42aee633"}], "security_groups": [{"name": "tempest-securitygroup--480584830"}], "key_name": "tempest-keypair-252816646", "user_data": "}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:25.653626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] validate_networks() for [('89dca715-3b69-4c8b-b0a5-998f42aee633', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:33:26.220051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:33:26.220468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:33:26.220958 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:33:26.221359 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:33:26.221792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:33:26.230692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.231169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.231599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.232317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:26.232768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:26.233189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:26.250142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:33:26.254085 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Getting quotas for user 0d4f8f3a6d42456d8e5cfbe20e54687a and project 27cd65c8d8044dddaf7a761697d216b4. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:33:26.265560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:33:26.267829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:33:26.315512 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-888ccdcd-2be7-417f-bad2-59f27057a13c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.768115 Sep 01 16:33:26.316151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 160/345] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:33:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:33:26.328029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8e3e1ce9-d857-4412-baca-c18c4daa3654 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:26.328740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8e3e1ce9-d857-4412-baca-c18c4daa3654 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:26.381629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8e3e1ce9-d857-4412-baca-c18c4daa3654 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:26.389166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8e3e1ce9-d857-4412-baca-c18c4daa3654 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1245 microversion: 2.1 time: 0.065612 Sep 01 16:33:26.389719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 186/346] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:26 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1245 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:27.409494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:27.410103 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:27.417235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.417723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.418158 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.418880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:27.419336 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:27.419758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:27.486147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:27.494521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-28d528a8-94d1-4c53-90db-5e6a42db3c7a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1297 microversion: 2.1 time: 0.088999 Sep 01 16:33:27.495100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 161/347] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:27 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:28.515869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:28.516761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:28.525897 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.527023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.527473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.528179 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:28.528631 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:28.529051 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:28.778310 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:28.787735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2196a85e-e52e-4e6f-803f-8564ceecb0e8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.275599 Sep 01 16:33:28.788490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 187/348] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:28 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:29.072329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-df3a2a21-a306-4d33-b8ea-e87d1954ba9d req-8fe43bef-c79c-44bf-8f2c-cb23ac229916 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0adaf7e-e196-4b8a-81d9-71bc129374ee", "tag": "ec332dc9-16e4-4644-9018-718ca145c843"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:29.087527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-df3a2a21-a306-4d33-b8ea-e87d1954ba9d req-8fe43bef-c79c-44bf-8f2c-cb23ac229916 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.088698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-df3a2a21-a306-4d33-b8ea-e87d1954ba9d req-8fe43bef-c79c-44bf-8f2c-cb23ac229916 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.089223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-df3a2a21-a306-4d33-b8ea-e87d1954ba9d req-8fe43bef-c79c-44bf-8f2c-cb23ac229916 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.101899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-df3a2a21-a306-4d33-b8ea-e87d1954ba9d req-8fe43bef-c79c-44bf-8f2c-cb23ac229916 service nova] Creating event network-changed:ec332dc9-16e4-4644-9018-718ca145c843 for instance d0adaf7e-e196-4b8a-81d9-71bc129374ee on hv-cinder-85220 Sep 01 16:33:29.108495 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-df3a2a21-a306-4d33-b8ea-e87d1954ba9d req-8fe43bef-c79c-44bf-8f2c-cb23ac229916 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045841 Sep 01 16:33:29.118310 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 162/349] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:29.810318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:29.810931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:29.816801 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.817279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.817708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.818420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:29.818890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:29.819320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:29.965631 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:29.973084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3415b175-6f72-462c-88cb-b3b13ceb0a52 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.166667 Sep 01 16:33:29.973635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 188/350] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:29 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:30.993220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:30.993923 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:30.996355 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:31.001798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.002327 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.002750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.003444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:31.003896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:31.004317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:31.138609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:31.146486 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a9363e9e-ccc6-411f-9348-d86bc3965aeb tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.157346 Sep 01 16:33:31.147057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 163/351] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:30 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:32.167514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:32.168112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:32.174120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.174761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.175188 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.175865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:32.176360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:32.176795 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:32.355206 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:32.362736 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-01bd5923-cb54-4f0f-bdd5-8dc3108e79d7 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.199049 Sep 01 16:33:32.363297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 189/352] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:32 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:33.384104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:33.384796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:33.391309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.391950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.392391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.393088 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:33.393543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:33.393968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:33.527958 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:33.536486 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9ecd9da3-ff42-4453-aaa5-189decfe0555 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.156605 Sep 01 16:33:33.537138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 164/353] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:33 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:34.558548 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:34.559166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:34.565261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.565778 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.566187 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.566983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:34.567446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:34.567866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:34.709243 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:34.719508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cd3a8f5e-32e7-49a9-8ad4-6e2e02c7ebed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.166308 Sep 01 16:33:34.720386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 190/354] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:34 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:35.741356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:35.741987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:35.748504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.748981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.749474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.750150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:35.750632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:35.751056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:35.879477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:35.887576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f8d9a5b6-0a54-4ed9-b2f5-941520c55bc9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.150128 Sep 01 16:33:35.888141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 165/355] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:35 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:36.910331 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:36.910935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:36.913099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:36.919234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.919747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.920180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:36.920863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:36.921311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:36.921728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.019152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-54dab1be-2bd3-4076-95d7-ace8be745d21 req-d7067e9d-fe9e-4f3e-902b-f90cff30f082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0adaf7e-e196-4b8a-81d9-71bc129374ee", "name": "network-vif-plugged", "status": "completed", "tag": "ec332dc9-16e4-4644-9018-718ca145c843"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:37.030960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:37.032073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:33:37.035493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-54dab1be-2bd3-4076-95d7-ace8be745d21 req-d7067e9d-fe9e-4f3e-902b-f90cff30f082 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:37.036052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-54dab1be-2bd3-4076-95d7-ace8be745d21 req-d7067e9d-fe9e-4f3e-902b-f90cff30f082 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:37.036558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-54dab1be-2bd3-4076-95d7-ace8be745d21 req-d7067e9d-fe9e-4f3e-902b-f90cff30f082 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:37.051644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-54dab1be-2bd3-4076-95d7-ace8be745d21 req-d7067e9d-fe9e-4f3e-902b-f90cff30f082 service nova] Creating event network-vif-plugged:ec332dc9-16e4-4644-9018-718ca145c843 for instance d0adaf7e-e196-4b8a-81d9-71bc129374ee on hv-cinder-85220 Sep 01 16:33:37.056767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-54dab1be-2bd3-4076-95d7-ace8be745d21 req-d7067e9d-fe9e-4f3e-902b-f90cff30f082 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041603 Sep 01 16:33:37.057488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 166/356] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:33:37.069469 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:37.078155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8098f38f-09ae-4f94-aba1-c5d5844f6fbe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.172464 Sep 01 16:33:37.088073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 191/357] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:36 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:33:38.100899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:38.101620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:38.108239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.108712 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.109146 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.109824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:38.110308 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:38.110733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:38.243506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:38.252449 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9addee2d-fc9d-4dce-8ec2-65891d663154 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.155935 Sep 01 16:33:38.253027 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 167/358] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:38 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:39.272790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:39.273392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:39.279388 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.279858 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.280284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.280961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:39.281409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:39.281827 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:39.411916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:39.420427 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c0ca830f-bd14-41d6-afeb-e21978cd55b4 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1370 microversion: 2.1 time: 0.151376 Sep 01 16:33:39.420992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 192/359] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:39 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:40.441473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:40.442108 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:40.449225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.449705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.450138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.450852 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.451309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.451733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.591006 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:33:40.599519 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-530b52bc-db4a-4046-8e85-93afd07eb52c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1565 microversion: 2.1 time: 0.161911 Sep 01 16:33:40.600096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 168/360] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:33:40 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:33:40.620014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:33:40.620533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:33:40.626452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.626925 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.627352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.628033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:40.628472 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:40.628884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:40.707148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9183bd58-dd73-471d-9891-addcf1e47200 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090941 Sep 01 16:33:40.707740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 193/361] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:33:40 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:33:42.044754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-f2dbb17d-a256-4315-bc5d-0d9712d6e193 req-c9c02775-c420-47a7-a3d9-e086b3a8b760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0adaf7e-e196-4b8a-81d9-71bc129374ee", "tag": "ec332dc9-16e4-4644-9018-718ca145c843"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:33:42.054699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-f2dbb17d-a256-4315-bc5d-0d9712d6e193 req-c9c02775-c420-47a7-a3d9-e086b3a8b760 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:33:42.055770 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-f2dbb17d-a256-4315-bc5d-0d9712d6e193 req-c9c02775-c420-47a7-a3d9-e086b3a8b760 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:33:42.056262 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-f2dbb17d-a256-4315-bc5d-0d9712d6e193 req-c9c02775-c420-47a7-a3d9-e086b3a8b760 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:33:42.069133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-f2dbb17d-a256-4315-bc5d-0d9712d6e193 req-c9c02775-c420-47a7-a3d9-e086b3a8b760 service nova] Creating event network-changed:ec332dc9-16e4-4644-9018-718ca145c843 for instance d0adaf7e-e196-4b8a-81d9-71bc129374ee on hv-cinder-85220 Sep 01 16:33:42.075570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-f2dbb17d-a256-4315-bc5d-0d9712d6e193 req-c9c02775-c420-47a7-a3d9-e086b3a8b760 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034314 Sep 01 16:33:42.076394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 169/362] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:28.406261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:28.407191 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:28.408641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:34:28.408792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:34:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/ips (ip 10.222.0.58) !!! Sep 01 16:34:28.413935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:28.414469 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:28.424526 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.425004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.425436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.426120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:28.426606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:28.427027 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:28.451610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a1cc22f7-7a1d-45da-9e91-7fb2923d057e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/ips" status: 200 len: 149 microversion: 2.1 time: 0.046333 Sep 01 16:34:28.452172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 194/363] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:34:28 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:29.824894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=13 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:29.825633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=68 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:29.830781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:29.831389 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:29.838341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.838818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.839252 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.839937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:29.840393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:29.840817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:29.863484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-da23f359-124a-4aaf-ad4f-937a86c4ed7e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/ips" status: 200 len: 151 microversion: 2.20 time: 0.040308 Sep 01 16:34:29.864048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 170/364] 10.222.0.58 () {60 vars in 1289 bytes} [Thu Sep 1 16:34:29 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:34:30.860963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd7afa02-b86b-4de7-9d27-5ef0ed5c391a"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:30.863345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:30.869240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.869709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.870138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:30.870841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:30.871287 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:30.871704 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:31.175786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-26de15e3-50a3-4062-beb9-2b5c4ef225bc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319117 Sep 01 16:34:31.176387 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 195/365] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:34:30 2022] POST /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:32.754719 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:32.755288 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:32.761526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.761995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.762451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.763126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:32.763572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:32.763991 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:32.786735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lazy-loading 'flavor' on Instance uuid 12bc543d-2b3a-4cf9-a341-42e36cea6368 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:34:33.014054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6f471b6f-a2a5-43f4-a4a3-87369774f624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/action" status: 202 len: 0 microversion: 2.20 time: 0.263971 Sep 01 16:34:33.014730 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 171/366] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Sep 1 16:34:32 2022] POST /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:34:33.024822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:33.025561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:33.034535 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.035093 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.035749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.037223 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:33.037709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:33.038180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:33.170736 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.178708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.180142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:33.181286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cd78faa2-c38f-4aae-999a-5c4ad01dc801 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.161917 Sep 01 16:34:33.181848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 196/367] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:33 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:34.205998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:34.206731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:34.215944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.216425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.216854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.217533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:34.217981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:34.218431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:34.345633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.353585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.355029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:34.356202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bb870fdd-4f92-4d57-8c16-95c0c7cb4c39 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.155604 Sep 01 16:34:34.356744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 172/368] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:34 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:35.379354 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:35.379895 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:35.386481 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.386993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.387424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.388104 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:35.388547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:35.388962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:35.523530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.532242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.533755 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:35.534937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-436c9a9d-6525-43e0-b298-663f20df67f5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.159547 Sep 01 16:34:35.535488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 197/369] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:35 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:36.558453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:36.559055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:36.565954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.566461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.566891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.567567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:36.568014 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:36.568432 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:36.700639 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.709624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.711099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:36.712249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f0e80e2c-226d-4c74-b69d-f0a973570400 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.157720 Sep 01 16:34:36.712804 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 173/370] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:36 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:37.735513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:37.736168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:37.742613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.743086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.743512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.744187 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:37.744633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:37.745049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:37.887847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.895901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.897331 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:37.898512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5134cd17-2fe5-4405-8477-7e89ae9ca104 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.167433 Sep 01 16:34:37.899087 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 198/371] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:37 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:38.707494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3fc4bf13-a49b-4295-baef-73a9142bb6b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: .version_select at 0x7f6c9cf52af0>, body: {"keypair": {"name": "tempest-keypair-200806085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrVT+MVH1myH67aBGIDgWjDiRQOGnRCyskiAxZq1OAxumVwvclwah4NRCbUH/hU10HzVUTcZIJfgiWe/hW4SyJfjP0yiiH8ttnjHH0sSIu/SsTfYXkeXF42G17AKPYL6A=="}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:38.727721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-3fc4bf13-a49b-4295-baef-73a9142bb6b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:38.731542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-3fc4bf13-a49b-4295-baef-73a9142bb6b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:38.767652 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3fc4bf13-a49b-4295-baef-73a9142bb6b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064008 Sep 01 16:34:38.768278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 174/372] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:34:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:38.921614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:38.922246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:38.929127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.929608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.930033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:38.930752 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:38.931392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:38.931614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:39.064086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.072514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.073949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:39.075208 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-38adf98e-9882-4928-9871-d8576652f68e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.157931 Sep 01 16:34:39.075774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 199/373] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:38 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:40.099556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.100229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.107400 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.107961 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.108477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.109361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.109819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.110295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.183627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2042151062", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56174d1-438e-442e-9134-7098a8e04072"}], "security_groups": [{"name": "tempest-securitygroup--1687515705"}], "key_name": "tempest-keypair-200806085", "user_data": "}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:40.239735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.247846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.249782 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.250978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2cfbe54d-3901-47aa-a2ed-a9ff22365a83 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.156262 Sep 01 16:34:40.251534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 175/374] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:40.286409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] validate_networks() for [('b56174d1-438e-442e-9134-7098a8e04072', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:34:40.652424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:34:40.652838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:34:40.653302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:34:40.653706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:34:40.654111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:34:40.663234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.663707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.664138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.664860 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:40.665306 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:40.665724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:40.682505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:34:40.686989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:34:40.697641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:34:40.699919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:34:40.748123 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7e0782fa-5299-4833-b470-fbdb08aecd54 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568637 Sep 01 16:34:40.748771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 200/375] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:34:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:34:40.759436 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-df59fa1b-17f9-497a-b6c4-94615299163e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:40.760034 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-df59fa1b-17f9-497a-b6c4-94615299163e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:40.817092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-df59fa1b-17f9-497a-b6c4-94615299163e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:40.824197 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-df59fa1b-17f9-497a-b6c4-94615299163e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1241 microversion: 2.1 time: 0.068486 Sep 01 16:34:40.824812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 176/376] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:40 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:41.275535 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:41.276165 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:41.283349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.283709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.284141 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.284829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.285292 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.285701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.413784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.422591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.424142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.425393 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-47ef3c8a-ae2b-4fe4-8807-d3c03e98b4a4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.154944 Sep 01 16:34:41.426020 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 201/377] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:41 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:41.851965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:41.852590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:41.860624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.861162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.861623 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.862396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:41.862882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:41.863303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:41.926916 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:41.937988 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ebd3e57b-40fd-4b83-af6e-8ea5f0b73e76 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1293 microversion: 2.1 time: 0.089959 Sep 01 16:34:41.938585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 177/378] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:41 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:42.449049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:42.449983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:42.457322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.457953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.458528 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.459363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.459958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.460475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.637102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.645772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.647244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:42.648379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9af49271-745e-43b8-8919-4b5236cd6e19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.203411 Sep 01 16:34:42.648931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 202/379] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:42 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:42.962034 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:42.963029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:42.973280 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.973961 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.974578 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:42.975656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:42.976373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:42.977030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.058132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.065924 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-99850e7f-773e-403d-8f0f-241808b642c1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1299 microversion: 2.1 time: 0.110113 Sep 01 16:34:43.066754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 178/380] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:42 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:43.671231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:43.671947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:43.678476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.679022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.679521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.680276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.680798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.681305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:43.883907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.892751 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.894062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:43.895363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f8a5d541-8f12-4c18-afca-503ca342118f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.228084 Sep 01 16:34:43.895931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 203/381] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:43 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:43.984269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-1d52fa2a-5453-45fb-ab66-1772488775e7 req-be061cd8-221b-466e-8b6f-dd21a9a3cc32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb4c143-3275-49a0-8082-844006bf4340", "tag": "cf351347-f64c-4e7c-97ec-1df7882305a5"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:43.994305 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-1d52fa2a-5453-45fb-ab66-1772488775e7 req-be061cd8-221b-466e-8b6f-dd21a9a3cc32 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:43.995405 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-1d52fa2a-5453-45fb-ab66-1772488775e7 req-be061cd8-221b-466e-8b6f-dd21a9a3cc32 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:43.996056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-1d52fa2a-5453-45fb-ab66-1772488775e7 req-be061cd8-221b-466e-8b6f-dd21a9a3cc32 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.008135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-1d52fa2a-5453-45fb-ab66-1772488775e7 req-be061cd8-221b-466e-8b6f-dd21a9a3cc32 service nova] Creating event network-changed:cf351347-f64c-4e7c-97ec-1df7882305a5 for instance 9fb4c143-3275-49a0-8082-844006bf4340 on hv-cinder-85220 Sep 01 16:34:44.012912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-1d52fa2a-5453-45fb-ab66-1772488775e7 req-be061cd8-221b-466e-8b6f-dd21a9a3cc32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Sep 01 16:34:44.013509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 179/382] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:44.087052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:44.087655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:44.093830 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.094341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.094768 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.095447 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.095886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.096457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.299515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:44.307832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-df96365e-acd6-402b-8d16-ed6e9490daed tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.224486 Sep 01 16:34:44.308454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 204/383] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:44 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:44.919996 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:44.920768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:44.927499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.927973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.928404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:44.929083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:44.929534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:44.929953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.057669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:45.065838 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:45.067346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:45.068482 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-69830ed0-8e34-4fd8-937d-d49f597eeb3b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.152809 Sep 01 16:34:45.069038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 180/384] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:44 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:45.329432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:45.329960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:45.336402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.336875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.337303 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.337981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:45.338455 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:45.338874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:45.462703 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:45.470416 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-52de01b0-0b8b-485d-ba1c-74697677a4f5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.145454 Sep 01 16:34:45.470978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 205/385] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:45 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:46.091797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:46.092426 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:46.098900 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.099426 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.099886 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.100573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.101029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.101455 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.230471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.239265 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.240705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.241891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-23edab32-9df8-49ba-9268-a5f0917ab47d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.154083 Sep 01 16:34:46.242502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 181/386] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:46 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:46.490824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:46.491429 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:46.497807 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.498355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.498787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.499464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:46.499919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:46.500333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:46.626015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:46.634497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2f6982c8-304e-474a-a36c-3270290167b9 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.147476 Sep 01 16:34:46.635075 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 206/387] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:46 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:47.265249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.265865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.272417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.272891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.273318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.273997 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.274471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.274891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.403124 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.411533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.412966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.414116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a94e231d-b79f-4cb3-ab0c-138670616b5c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.153432 Sep 01 16:34:47.414709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 182/388] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:47.656750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:47.657359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:47.664072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.664555 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.664985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.666564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:47.667209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:47.667642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:47.876431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:47.884040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a0b7f5e5-2c0f-43d8-8cdf-061ecc26a1d0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.231345 Sep 01 16:34:47.884609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 207/389] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:47 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:48.437692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.438346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.444689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.445168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.445604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.446328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.446788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.447215 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.570723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.579364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.580811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:48.582053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8c6510d7-4076-4373-b041-0656c94fbea7 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.148657 Sep 01 16:34:48.582604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 183/390] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:48.904545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:48.905068 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:48.911815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.912289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.912719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:48.913397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:48.913845 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:48.914296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.042066 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.050255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9af87f59-65e6-4054-aea7-f724c3c9496b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.149574 Sep 01 16:34:49.050817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 208/391] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:48 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:49.497558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.498675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.505008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.505489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.505928 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.506681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.507143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.507571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.532688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3faf3334-c068-40a5-878d-d521a8badd6d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/ips" status: 200 len: 145 microversion: 2.1 time: 0.038918 Sep 01 16:34:49.533263 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 184/392] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:49.604349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:49.604958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:49.611701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.612166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.612598 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.613283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:49.613731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:49.614148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:49.744725 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.756391 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.757806 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:49.758988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e386c90b-a768-4ded-8632-bb14d58a574c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.158694 Sep 01 16:34:49.759552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 209/393] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:49 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:50.071439 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:50.072048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:50.078656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.079143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.079574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.080322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.080782 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.081206 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.208041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.215880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-249059b6-cc84-46c1-a483-64fadef1d376 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.148306 Sep 01 16:34:50.216450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 185/394] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:50 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:50.781941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:50.782594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:50.785042 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:50.785872 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:50.791755 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.792232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.792662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.793342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:50.793798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:50.794251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:50.798335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:50.927242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.935185 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.937128 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:50.938298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c9b2de3e-a077-466c-9a47-f7204d990124 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1744 microversion: 2.20 time: 0.160431 Sep 01 16:34:50.938856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 210/395] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:50 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:51.236524 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.237130 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.239597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:51.245136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.245620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.246054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.246784 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.247269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.247737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.376277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:51.384294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ce9bcacb-6ada-402b-8f8a-eada4a2981e8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.151756 Sep 01 16:34:51.384864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 186/396] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:51.961362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:51.961928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:51.968497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.968984 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.969482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:51.970169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:51.970650 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:51.971069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.098779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.106761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.108787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.109974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0432b1a1-0736-45e1-a05c-59c522a33fa6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1744 microversion: 2.20 time: 0.152476 Sep 01 16:34:52.110710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 211/397] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:51 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:52.338694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-68862188-e5ee-44d3-bb8d-c22684b8925e req-a09f268c-7fc3-47bb-a71c-923adac7d0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb4c143-3275-49a0-8082-844006bf4340", "name": "network-vif-plugged", "status": "completed", "tag": "cf351347-f64c-4e7c-97ec-1df7882305a5"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:52.351853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-68862188-e5ee-44d3-bb8d-c22684b8925e req-a09f268c-7fc3-47bb-a71c-923adac7d0d3 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.352325 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-68862188-e5ee-44d3-bb8d-c22684b8925e req-a09f268c-7fc3-47bb-a71c-923adac7d0d3 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.352934 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-68862188-e5ee-44d3-bb8d-c22684b8925e req-a09f268c-7fc3-47bb-a71c-923adac7d0d3 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.364889 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-68862188-e5ee-44d3-bb8d-c22684b8925e req-a09f268c-7fc3-47bb-a71c-923adac7d0d3 service nova] Creating event network-vif-plugged:cf351347-f64c-4e7c-97ec-1df7882305a5 for instance 9fb4c143-3275-49a0-8082-844006bf4340 on hv-cinder-85220 Sep 01 16:34:52.369750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-68862188-e5ee-44d3-bb8d-c22684b8925e req-a09f268c-7fc3-47bb-a71c-923adac7d0d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034869 Sep 01 16:34:52.370553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 187/398] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:52.405514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:52.406792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.413392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.413935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.414471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.415305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.415846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.416406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.620614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:52.629339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b10f38d9-5fba-4f51-8873-e310fe0d6509 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.228305 Sep 01 16:34:52.629922 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 212/399] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:52 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:52.773351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c28b0de5-d460-41dc-9fd2-e8c4e9dd78b7"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:52.775833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:52.782958 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.783444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.783881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.784572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:52.785078 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:52.785453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:52.803446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:53.132941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:53.133671 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.140394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.141034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.141314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.142001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.142481 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.142909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.270154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.278541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.280483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.281992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-eb8d17fa-04b7-4040-8ab2-4a2c76813dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1744 microversion: 2.20 time: 0.152944 Sep 01 16:34:53.282658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 213/400] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:34:53.472231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-307196d6-d0a1-4441-8478-b72ac2d2bec9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.702999 Sep 01 16:34:53.473332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 188/401] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:34:52 2022] POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:53.651160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:53.651684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:53.658347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.658834 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.659272 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.659958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:53.660414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:53.660839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:53.786315 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:53.793863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2b049ae6-6154-4164-b478-65bb8009235e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.147027 Sep 01 16:34:53.794456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 214/402] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:53 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:54.305915 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:54.307177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:54.317682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.319032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.319690 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.320650 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.321110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.321705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.471510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.479631 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.481061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.482970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-af0601d6-d0d2-4aa9-9b8e-44d7b9ea015f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1744 microversion: 2.20 time: 0.181213 Sep 01 16:34:54.483533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 189/403] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:54 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:54.815925 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:54.816464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:54.822837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.823322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.823757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.824445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:54.824900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:54.825324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:54.956743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:54.964314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0e829e9e-1c08-4ca5-9880-92476ec605cc tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1367 microversion: 2.1 time: 0.152311 Sep 01 16:34:54.964873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 215/404] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:54 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:55.504870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.505473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.511859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.512334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.512763 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.513442 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.513906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.514359 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.646061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.655092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.656779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:55.657931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-344b6271-f107-4069-9687-faaef5a863b6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1744 microversion: 2.20 time: 0.156990 Sep 01 16:34:55.658507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 190/405] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:55.984807 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:55.985440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:55.991904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.992384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.992812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:55.993490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:55.993938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:55.994397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.121287 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.129564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-44bf1277-bd03-4cc8-ad64-ed8130c88f90 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1556 microversion: 2.1 time: 0.148667 Sep 01 16:34:56.130130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 216/406] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:34:55 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:34:56.150095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.150616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.157215 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.157692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.158124 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.158831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.159284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.159704 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.238823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-22091954-b9dc-4f13-974a-e69530206e02 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092377 Sep 01 16:34:56.239501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 191/407] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:56.337539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-26ae37ec-ba10-4f2f-8601-6bf12b0d5604 req-72bd6e5f-acfa-4317-92a8-aac2f75eb464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "name": "network-vif-plugged", "status": "completed", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:56.350041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-26ae37ec-ba10-4f2f-8601-6bf12b0d5604 req-72bd6e5f-acfa-4317-92a8-aac2f75eb464 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.350643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-26ae37ec-ba10-4f2f-8601-6bf12b0d5604 req-72bd6e5f-acfa-4317-92a8-aac2f75eb464 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.351175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-26ae37ec-ba10-4f2f-8601-6bf12b0d5604 req-72bd6e5f-acfa-4317-92a8-aac2f75eb464 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.364490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-26ae37ec-ba10-4f2f-8601-6bf12b0d5604 req-72bd6e5f-acfa-4317-92a8-aac2f75eb464 service nova] Creating event network-vif-plugged:9934d19e-6301-4c24-8a8b-6d0bf27e8bbd for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 on hv-cinder-85220 Sep 01 16:34:56.369867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-26ae37ec-ba10-4f2f-8601-6bf12b0d5604 req-72bd6e5f-acfa-4317-92a8-aac2f75eb464 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036601 Sep 01 16:34:56.370750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 217/408] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:56.681416 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:56.682025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:56.688948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.689459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.689904 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.690628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:56.691120 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:56.691546 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:56.907728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.915803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.917237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:56.918433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9a36ea29-32bf-4a06-881a-523ba5129fd5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1744 microversion: 2.20 time: 0.241187 Sep 01 16:34:56.918996 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 192/409] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:56 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1744 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:57.250634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-5a043eb6-2b4f-4bf0-82dc-25da5ad91bdf req-afcbf001-3cac-4a11-b58d-9b5489f370c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fb4c143-3275-49a0-8082-844006bf4340", "tag": "cf351347-f64c-4e7c-97ec-1df7882305a5"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:34:57.260272 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5a043eb6-2b4f-4bf0-82dc-25da5ad91bdf req-afcbf001-3cac-4a11-b58d-9b5489f370c8 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.260851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5a043eb6-2b4f-4bf0-82dc-25da5ad91bdf req-afcbf001-3cac-4a11-b58d-9b5489f370c8 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.261366 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5a043eb6-2b4f-4bf0-82dc-25da5ad91bdf req-afcbf001-3cac-4a11-b58d-9b5489f370c8 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.273548 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-5a043eb6-2b4f-4bf0-82dc-25da5ad91bdf req-afcbf001-3cac-4a11-b58d-9b5489f370c8 service nova] Creating event network-changed:cf351347-f64c-4e7c-97ec-1df7882305a5 for instance 9fb4c143-3275-49a0-8082-844006bf4340 on hv-cinder-85220 Sep 01 16:34:57.278634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-5a043eb6-2b4f-4bf0-82dc-25da5ad91bdf req-afcbf001-3cac-4a11-b58d-9b5489f370c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033077 Sep 01 16:34:57.279447 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 218/410] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:34:57.942681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:57.945461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:57.954393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.955161 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.955796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:57.956698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:57.957492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:57.958111 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:58.218407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.228641 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.230601 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:58.232650 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d1e44baf-7e12-4b79-8629-8a6530e66004 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.294536 Sep 01 16:34:58.247841 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 193/411] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:57 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:34:59.258635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:34:59.259323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:34:59.261261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:34:59.269010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.269874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.270484 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.271484 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:34:59.272151 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:34:59.272646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:34:59.421715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:59.429797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:59.431255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:34:59.432402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-78ec74a6-1b05-441c-9213-acc016d7c73e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.179143 Sep 01 16:34:59.432957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 219/412] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:34:59 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:00.455622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:00.456222 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:00.458720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:00.464275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.464748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.465175 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.465854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:00.466322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:00.466736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:00.601522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.610349 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.611770 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:00.612903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-18628f05-e5f3-488b-902f-c97d8601523b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.161137 Sep 01 16:35:00.613478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 194/413] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:00 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:01.636938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:01.637530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:01.643936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.644414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.644848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.645539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:01.645989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:01.646448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:01.782384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.791124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.792544 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:01.794723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-73afa142-7c47-4d9b-ac03-4e941acc5f1f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.161427 Sep 01 16:35:01.795305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 220/414] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:01 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:02.817221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:02.817932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:02.824837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.825406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.825926 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.826703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:02.827230 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:02.827953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:02.963339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:02.972118 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:02.973549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:02.974727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7ab1f35b-d0fe-41a9-8669-c22d6304655e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.161605 Sep 01 16:35:02.975282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 195/415] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:02 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:03.153733 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1e654956-12d7-490e-9b8c-c7afc6b08d25 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:03.160708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e654956-12d7-490e-9b8c-c7afc6b08d25 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.161180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e654956-12d7-490e-9b8c-c7afc6b08d25 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.161607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1e654956-12d7-490e-9b8c-c7afc6b08d25 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.220890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1e654956-12d7-490e-9b8c-c7afc6b08d25 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Going to try to stop instance {{(pid=120692) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:35:03.264824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1e654956-12d7-490e-9b8c-c7afc6b08d25 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action" status: 202 len: 0 microversion: 2.1 time: 0.114710 Sep 01 16:35:03.265629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 221/416] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:03 2022] POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:35:03.273425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:03.274279 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:03.283185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.283795 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.284353 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.285123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:03.285653 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:03.286150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:03.424886 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:03.433607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-920ee618-9e48-4d6a-b03a-f6500672b412 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.163980 Sep 01 16:35:03.434187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 196/417] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:03 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:03.999482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:04.001240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:04.007577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.008055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.008482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.009171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.009620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.010039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.151175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.161298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.162740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.163918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ae27327b-3bd3-4207-afbc-c7b7bb867169 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.168826 Sep 01 16:35:04.164855 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 222/418] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:03 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:04.460561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:04.461170 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:04.467692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.468166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.468604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.469296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:04.469751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:04.470492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:04.618525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:04.629102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-272003ed-b203-4cea-9cd6-9894898ab6f9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.174788 Sep 01 16:35:04.630364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 197/419] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:04 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:05.188266 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.189568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.197108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.197589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.198018 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.198734 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.199182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.199599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.339260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.347660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.349170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.350426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3df39824-073d-406f-ae55-35ce2b58ed1b tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.167090 Sep 01 16:35:05.351233 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 223/420] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:05.652255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:05.652810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:05.660312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.660790 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.661221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.661906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:05.662390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:05.662813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:05.821832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:05.831518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cf6088b1-18be-4f11-a07d-740664f7211b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.183466 Sep 01 16:35:05.832407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 198/421] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:05 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:06.378670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.379365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:06.386164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.386682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.387116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.388399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.388853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.389273 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.546508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:06.554930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:06.556284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:06.557443 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b377ccc1-6599-49de-9d10-2616291245c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.187912 Sep 01 16:35:06.558236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 224/422] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:06.852271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:06.853012 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:06.860422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.860983 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.861513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:06.862362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:06.862890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:06.863392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.007016 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.016620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ec4101f4-382f-43e1-bc41-0864be509e82 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.168585 Sep 01 16:35:07.017189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 199/423] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:06 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:07.581302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:07.582965 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:07.590106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.590952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.591602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.592514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:07.593187 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:07.593816 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:07.756081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.765189 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.766665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:07.767833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0b5c6f5a-334a-4a7b-becc-57faadbefe4c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.190501 Sep 01 16:35:07.778501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 225/424] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:07 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:08.040015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:08.040627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:08.048274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.048750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.049616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.049856 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.050329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.050975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.197172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:08.207473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3afc5ff3-efe8-4eba-9adf-6477f99f0007 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.171892 Sep 01 16:35:08.208752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 200/425] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:08 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:08.791161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:08.792436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:08.800325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.800815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.801249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.801943 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:08.802428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:08.802854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:08.946637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:08.955254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:08.956687 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:08.957837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-68da21b1-e496-437b-b3b5-ff3c92400b64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.170555 Sep 01 16:35:08.958416 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 226/426] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:08 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:09.240577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:09.241562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:09.259053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.259548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.259989 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.260702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.261163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.261592 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.401104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:09.416506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c87e33cb-2e2d-4727-8532-1f2d2fca23c6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.188237 Sep 01 16:35:09.416869 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 201/427] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:09 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:09.980973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:09.981589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:09.988020 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.988498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.988928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.989608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:09.990064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:09.990509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:09.994545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:10.135261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:10.145133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:10.146889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:10.148246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7af8bac2-67ae-4bf1-ae7c-21290292d349 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.171177 Sep 01 16:35:10.149242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 227/428] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:09 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:10.436990 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:10.437685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:10.443820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:10.444298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:10.444735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:10.445415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:10.445870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:10.446323 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:10.576927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:10.586292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-04f50786-3690-4e7a-9cc9-776ba32c5677 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.153383 Sep 01 16:35:10.586862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 202/429] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:10 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:11.171615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:11.172241 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:11.178676 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.179153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.179591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.180265 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.180715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.181133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.311937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:11.319932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:11.321351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:11.322518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-44228afc-33f2-44cc-967d-b7a4b16e26fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1739 microversion: 2.20 time: 0.155424 Sep 01 16:35:11.323082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 228/430] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:11 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:11.607801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:11.608409 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:11.614713 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.615180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.615604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:11.616272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:11.616718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:11.617133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.033069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:12.041343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-55c6d9f4-8610-41fb-b936-ed9bcba93877 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.437342 Sep 01 16:35:12.041917 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 203/431] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:11 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:12.352115 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:12.353294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:12.360038 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:12.360540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:12.360972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.361720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:12.362213 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:12.362647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:12.506027 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:12.514593 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:12.516024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:12.517164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bdc6e5e4-a5c5-472a-bb59-93365f4edebb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1721 microversion: 2.20 time: 0.169116 Sep 01 16:35:12.517717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 229/432] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:12 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:13.063710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:13.064351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:13.070789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.071270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.071702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.072846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.072846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.073278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.077560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:13.204497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:13.212745 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1af0ffba-c96d-4306-952e-4b0607261061 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.153584 Sep 01 16:35:13.213320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 204/433] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:13 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:13.540963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:13.541563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:13.548675 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.549177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.549605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.550309 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:13.550759 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:13.551176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:13.679871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:13.688580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:13.690017 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:13.691202 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-01dbadf5-ba13-4a6e-9fb5-f2e32f0f5c6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1721 microversion: 2.20 time: 0.154135 Sep 01 16:35:13.691773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 230/434] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:13 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:14.235162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:14.235767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:14.242159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.242678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.243117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.243833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.244287 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.244737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.374779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.382888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4f01a6cf-66dc-41bc-803c-129b98bb5038 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.151702 Sep 01 16:35:14.383451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 205/435] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:14 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:14.714492 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:14.715811 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:14.722272 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.722758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.723187 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.723870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.724322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.724743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.858541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.866687 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.868137 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:14.869289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-31d0da0d-89e8-4eef-a4fe-10bce279746e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1724 microversion: 2.20 time: 0.158787 Sep 01 16:35:14.869831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 231/436] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:14 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:14.891406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4afb5ebd-f102-4a91-95c3-02543b11ff91"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:14.893940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:14.900217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.900626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.901530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:14.901792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:14.902273 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:14.903205 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.197703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e14d4018-69b4-492a-be41-a9449ffb78cc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310354 Sep 01 16:35:15.198326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 206/437] 10.222.0.58 () {62 vars in 1364 bytes} [Thu Sep 1 16:35:14 2022] POST /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:35:15.322042 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:15.322656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.328610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.329085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.329509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.330261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.330652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.331064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.375699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120692) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:35:15.403312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:15.403976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.411968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.412680 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.413117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.413822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.414304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.414727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.445454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6af70f6f-ec98-464a-879a-93f3a0c97236 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/action" status: 202 len: 0 microversion: 2.20 time: 0.127359 Sep 01 16:35:15.449050 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 232/438] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Sep 1 16:35:15 2022] POST /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:35:15.454102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:15.454735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:15.460941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.461934 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.462413 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.463286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:15.463740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:15.464171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:15.622665 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.632122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0aaaa319-eba3-464a-8b84-a0c0cfe3c705 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.232890 Sep 01 16:35:15.638849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 207/439] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:15 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:15.658154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.667001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.668439 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:15.669627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2e8720ff-7e6b-430a-94be-85b077d96a46 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1750 microversion: 2.20 time: 0.219435 Sep 01 16:35:15.670546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 233/440] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:15 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1750 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:16.406444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-12099bba-8a25-4ce9-bee4-b5bcb9ef1e39 req-ce6ed025-bbc5-4724-ad7f-8741e3626d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "name": "network-vif-unplugged", "status": "completed", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:16.416972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-12099bba-8a25-4ce9-bee4-b5bcb9ef1e39 req-ce6ed025-bbc5-4724-ad7f-8741e3626d1f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.417536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-12099bba-8a25-4ce9-bee4-b5bcb9ef1e39 req-ce6ed025-bbc5-4724-ad7f-8741e3626d1f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.418108 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-12099bba-8a25-4ce9-bee4-b5bcb9ef1e39 req-ce6ed025-bbc5-4724-ad7f-8741e3626d1f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.432233 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.compute.server_external_events [req-12099bba-8a25-4ce9-bee4-b5bcb9ef1e39 req-ce6ed025-bbc5-4724-ad7f-8741e3626d1f service nova] Unable to find a host for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368. Dropping event network-vif-unplugged {{(pid=120693) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:35:16.433347 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-12099bba-8a25-4ce9-bee4-b5bcb9ef1e39 req-ce6ed025-bbc5-4724-ad7f-8741e3626d1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031574 Sep 01 16:35:16.434925 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 208/441] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 16:35:16.653823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:16.654459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:16.661052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.661533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.661966 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.662679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.663207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.663627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.696375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:16.696985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:16.702994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.703477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.703913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.704606 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:16.705065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:16.705488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:16.851653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.859871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-906a043b-80e2-4132-a0a2-859888294213 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.209836 Sep 01 16:35:16.860631 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 234/442] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:16 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:16.877552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.886073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.887950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:16.889081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e115fc26-3828-4781-b60c-be065d62c65d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1752 microversion: 2.20 time: 0.197229 Sep 01 16:35:16.889638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 209/443] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:16 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1752 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:17.880279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:17.880877 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:17.887963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.888431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.888856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.889533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.889974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.890417 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.912660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:17.913294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:17.920385 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.920893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.921329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:17.922023 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:17.922510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:17.922939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:18.075267 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.083475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bffbcf26-ef99-498f-a1f3-f87409fc91fd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.206933 Sep 01 16:35:18.084041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 235/444] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:17 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:18.099133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.107873 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.109288 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:18.110485 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0607764d-9841-46c9-b216-a6fe88fcbefd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.201816 Sep 01 16:35:18.111039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 210/445] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:17 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:19.105130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:19.105734 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:19.112239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.112709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.113132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.113807 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.114279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.114700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.132823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:19.133419 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:19.140585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.141439 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.141886 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.142630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:19.143427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:19.143619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:19.312595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:19.321645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8ad11070-2969-48c7-8b6a-35298e488350 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.220397 Sep 01 16:35:19.322250 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 236/446] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:19 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:19.346039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:19.356667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:19.358228 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:19.359615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-78db49fd-f131-404e-8aa3-9ba8475af8ef tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.230553 Sep 01 16:35:19.360185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 211/447] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:19 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:20.343493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:20.344074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:20.350592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.351071 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.351498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.352181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.352628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.353044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.382938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:20.383542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:20.390022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.390531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.390967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.391656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:20.392106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:20.392541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:20.527747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.546261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5eb2cd69-e136-4db3-acd2-183093745ea7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.206688 Sep 01 16:35:20.557211 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 237/448] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:20 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:20.562050 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.574062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.575535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:20.576917 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1dcf89ae-c141-4247-a40f-bf638ea9086c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.197787 Sep 01 16:35:20.577647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 212/449] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:20 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:21.579471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.580089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.588737 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.589235 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.589673 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.590410 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.590868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.591294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.601816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:21.602542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:21.609073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.609789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.610335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.611184 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:21.611676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:21.612099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:21.802430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.806464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.811107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-34162e14-c50f-4720-97b6-be2b91ca504a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.235388 Sep 01 16:35:21.811799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 238/450] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:21.816065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.817477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:21.818676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1fa99853-c9f2-48d0-b982-4752277e9b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.221199 Sep 01 16:35:21.819423 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 213/451] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:21 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:22.832974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.833587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.842145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.842657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.843091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.843790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.843899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:22.844364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.844469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:22.844687 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.852415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.853169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.853767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:22.854697 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:22.855346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:22.856074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:23.059536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:23.062784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:23.071576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-50ac29b9-9246-4432-8852-367f9d9e425d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.242436 Sep 01 16:35:23.072345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 239/452] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:23.073044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:23.075291 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:23.076664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-47607374-4564-4d56-a6b1-1559ba584dcf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.237740 Sep 01 16:35:23.077377 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 214/453] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:22 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:24.092858 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:24.093579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:24.100582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.100776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:24.101254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.101339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:24.101586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.102219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.102681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.103099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.108937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.108937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.109201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.109767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:24.110251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:24.110684 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:24.324145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.324734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.336807 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.338414 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:24.339605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3e73ab28-e002-433f-8c73-0dbe418c4209 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.242738 Sep 01 16:35:24.339728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-54b52f28-01ec-4955-b6b9-21768e263ff4 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.250598 Sep 01 16:35:24.340447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 215/454] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:24 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:24.341120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 240/455] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:24 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:25.361334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.362091 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.363978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:25.364581 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:25.368553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.369026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.369450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.370134 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.371148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.371562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.371750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.372224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.372648 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.373352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:25.373798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:25.374228 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:25.565071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.567881 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.573479 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-309e3670-0f4c-4fa0-8ee3-1b626e7a8600 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.216044 Sep 01 16:35:25.574741 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 216/456] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:25 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:25.577172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.578866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:25.580029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-410f4c38-aa48-4f95-b9b7-4322cc4cbe58 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.220797 Sep 01 16:35:25.580573 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 241/457] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:25 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:26.600010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.600010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.607163 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:26.607744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.607862 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:26.607971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.608314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.609025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.609488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.609917 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.619175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.619175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.619874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.624246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:26.624246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:26.624246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:26.830984 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.833915 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.834446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:26.841630 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.842942 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3fb11f15-a21b-44da-aa5a-961e40369fb5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.247876 Sep 01 16:35:26.843499 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:26.843646 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 217/458] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:26.844939 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9e12aa6b-a3b8-4064-a974-ad88e779518d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.244003 Sep 01 16:35:26.845819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 242/459] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:26 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:27.864936 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:27.865526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:27.869145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:27.869613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:27.872912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.873397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.874074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.875120 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.875612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.876235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.877960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.878466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.878900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:27.879596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:27.880038 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:27.880457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:28.091908 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.095335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:28.096844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.100880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f49b23c5-a3b5-4f93-b887-bf49f8dbec1d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.239832 Sep 01 16:35:28.101453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 218/460] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:27 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:28.105666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.107130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:28.108274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8ddd21df-51e3-4ec7-b567-23663677a807 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.243852 Sep 01 16:35:28.113801 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 243/461] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:27 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:29.123163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:29.125214 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:29.130871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:29.131708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:29.131938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.132433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.132865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.133556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.134002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.134453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.139895 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.140468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.140985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.143319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:29.143865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:29.144368 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:29.357209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.360925 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.365862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1ffd1a63-4592-4b50-8bc3-9e808a144a8e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.246882 Sep 01 16:35:29.366586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 219/462] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:29 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:29.369827 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.371442 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:29.372591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b7dd158e-bcdb-49c7-b01d-0f61e4ff7517 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.246129 Sep 01 16:35:29.373150 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 244/463] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:29 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:30.388421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.390566 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.395327 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.395563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:30.396010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.396213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.396493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:30.396893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.397339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.397753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.398818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:30.404898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.405383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.405809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.406519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:30.406967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:30.407375 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:30.599709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.603035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.611342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.611983 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-84ac9de2-3411-4bb8-a6cd-c683568fb5df tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.228046 Sep 01 16:35:30.612565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 220/464] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:30.612877 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:30.614231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-965d4bbf-8e6a-4dc3-820a-8ada253074df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.222400 Sep 01 16:35:30.630399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 245/465] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:30 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:31.633397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:31.634012 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:31.636841 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=54 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:31.641831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:31.642493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:31.642689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.643181 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.643614 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.644303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.644763 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.645187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.648636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.649125 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.649557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.650276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:31.650731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:31.651150 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:31.834485 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.837469 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.843415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-480d6ab5-f51a-4052-87f5-37cc40bc9681 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.213873 Sep 01 16:35:31.844281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 221/466] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:31 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:31.846880 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.848310 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:31.849491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e05c1660-d8e2-42f2-bc70-88c5ad23209f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.212074 Sep 01 16:35:31.850037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 246/467] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:31 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:32.864326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:32.866350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:32.871025 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:32.871451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.871612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.871720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:32.872045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.872738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.873195 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.873614 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.878568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.879052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.879487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:32.880179 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:32.880630 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:32.881053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:33.067737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:33.070893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:33.076992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9782ec7c-66ef-43cf-8c64-daa1aeb67e37 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.216478 Sep 01 16:35:33.077574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 222/468] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:32 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:33.080390 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:33.081838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:33.083008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a8111117-0982-40bf-96c3-04ad9c80fd92 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.215854 Sep 01 16:35:33.083546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 247/469] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:32 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:34.098822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:34.099452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:34.105860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.106124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:34.106570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.106763 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:34.106918 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.107486 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.107946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.108374 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.112989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.113463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.113887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.114592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:34.115037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:34.115450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:34.297949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:34.301708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:34.306869 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7beb2a48-d69c-43f4-93eb-a9babaee4041 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1721 microversion: 2.1 time: 0.211942 Sep 01 16:35:34.308617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 223/470] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:34 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:34.312796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:34.315103 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:34.316461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-24f76bd6-04d7-4ef3-9c51-deb6b9022e62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.214199 Sep 01 16:35:34.317035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 248/471] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:34 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:35.329064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.329609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.335898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.336363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.336789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.337461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.337913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.338356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.342009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.342646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.349097 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.349576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.350008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.350730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.351178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.351597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.534270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.538664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.543026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-eeb361e7-8966-46f8-b19d-548e9f588456 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1698 microversion: 2.1 time: 0.218002 Sep 01 16:35:35.543634 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 224/472] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:35 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1698 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:35.547510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.549068 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.550239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e55f69f7-cfc7-4feb-89d4-116347d58e24 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.213037 Sep 01 16:35:35.550788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 249/473] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:35 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:35.563474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4f2a0bd8-51e5-4484-aeec-212d0b16ec74 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:35.569810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f2a0bd8-51e5-4484-aeec-212d0b16ec74 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.570314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f2a0bd8-51e5-4484-aeec-212d0b16ec74 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.570747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f2a0bd8-51e5-4484-aeec-212d0b16ec74 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.631828 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4f2a0bd8-51e5-4484-aeec-212d0b16ec74 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Going to try to start instance {{(pid=120693) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:35:35.676334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4f2a0bd8-51e5-4484-aeec-212d0b16ec74 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action" status: 202 len: 0 microversion: 2.1 time: 0.116943 Sep 01 16:35:35.676965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 225/474] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:35 2022] POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:35:35.688627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:35.689095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:35.699457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.699941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.700385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.701078 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:35.701522 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:35.701937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:35.835611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:35.844517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2e1516bd-6236-4e5a-aa3c-7c576d06fb1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1707 microversion: 2.1 time: 0.161027 Sep 01 16:35:35.845079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 250/475] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:35 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1707 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:36.576518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:36.577219 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:36.583333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.583813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.584272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.584978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.585572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.586007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.792769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:36.801577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:36.803058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:36.804211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8163edbb-98bd-412b-8bb3-146bcd565d97 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.232493 Sep 01 16:35:36.804782 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 226/476] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:36 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:36.866456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:36.867092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:36.873598 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.874076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.874539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:36.875228 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:36.875717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:36.876140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.220602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.228735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-85e6ced0-05be-41cc-9b07-2de5124dc561 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1707 microversion: 2.1 time: 0.366135 Sep 01 16:35:37.229295 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 251/477] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:36 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1707 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:37.827211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:37.827817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:37.834271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:37.834750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:37.835185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.835863 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:37.836314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:37.836735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:37.965940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.974676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.976113 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:37.977259 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cc1000a4-aaf9-469b-8574-096052d06624 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.153976 Sep 01 16:35:37.977823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 227/478] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:37 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:38.249428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:38.250062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.256449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.256926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.257353 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.258034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.258509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.258932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.389865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:38.398166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4a1c9867-c079-4ee4-9cbe-a75e9168ab55 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1707 microversion: 2.1 time: 0.153071 Sep 01 16:35:38.398766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 252/479] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:38 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1707 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:38.451718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "170b6bff-8bdb-4c11-a231-93d251b5e986"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:38.454143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:38.460192 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.460675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.461106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.461791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:38.462266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:38.462692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:38.747020 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-443afdd9-e8e9-4332-8672-1ba41174b3a5 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299636 Sep 01 16:35:38.747650 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 228/480] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:35:38 2022] POST /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:35:39.000735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:39.001375 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:39.007549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.008066 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.008584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.009325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.009847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.010430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.141036 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:39.149927 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:39.152095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:39.153400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7e0e1db2-ed62-49e9-90c5-713beee9737c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.156691 Sep 01 16:35:39.154013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 253/481] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:38 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:39.422559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:39.423255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:39.429293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.429762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.430186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.430952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:39.431400 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:39.431820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:39.560705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:39.568888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b01cfb5e-85bc-4417-89ca-faf51cc7618b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1711 microversion: 2.1 time: 0.151060 Sep 01 16:35:39.569462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 229/482] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:39 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:40.176993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:40.177597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:40.184530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.184999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.185431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.186108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:40.186584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:40.187003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:40.318756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.327802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.329231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:40.330418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5d055491-d7a9-4d59-846d-5dc17534ca9d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.157270 Sep 01 16:35:40.330976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 254/483] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:40 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:41.353523 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:41.354150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:41.360662 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.361137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.361569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.362280 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:41.362734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:41.363159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:41.493179 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.501957 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.503428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:41.504569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f0f145b6-e87f-4e1b-bbad-ea60799d3695 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.154983 Sep 01 16:35:41.505134 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 230/484] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:41 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:42.527742 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:42.528344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:42.538583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.539405 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.540098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.541072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:42.541529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:42.542043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:42.670882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:42.679402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:42.680841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:42.682536 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a52db575-77a0-4698-9215-95bbd4db616d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.158116 Sep 01 16:35:42.683091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 255/485] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:42 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:43.704956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:43.705593 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:43.712153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:43.712659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:43.713689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.714415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:43.714882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:43.715308 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:43.888944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.897897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.899460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:43.901272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-43fd39ce-98ca-46b9-acef-d9f84d1e1b15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.199608 Sep 01 16:35:43.901842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 231/486] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:43 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:44.924986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:44.925599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:44.932321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.932794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.933228 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:44.933915 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:44.934412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:44.934840 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:45.132799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:45.141867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:45.143324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:45.144461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-85916220-10ea-49d2-8f32-d27bc20c6639 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.223356 Sep 01 16:35:45.145007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 256/487] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:44 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:46.168100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:46.168712 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:46.175249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:46.175729 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:46.176168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.176859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:46.177319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:46.177743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:46.307320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:46.315862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:46.317309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:46.318501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fde80da1-b841-4c60-954a-0c811270c9ad tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.154687 Sep 01 16:35:46.319066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 232/488] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:46 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:47.330074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:47.332383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:47.338997 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.339476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.339905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.340507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:47.340942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.341106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.341339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:47.341532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.347531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.348011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.348442 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.349124 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.349579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.350004 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.354695 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.364724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'flavor' on Instance uuid d0adaf7e-e196-4b8a-81d9-71bc129374ee {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:35:47.483765 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:35:47.491734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.503206 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.504682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.505866 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7f569097-d4ee-439c-91a8-dc55704b0457 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.169164 Sep 01 16:35:47.506842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 233/489] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:47 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:35:47.507344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-48cb20ce-8835-479d-82f4-8db66ead636a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/action" status: 200 len: 32 microversion: 2.1 time: 0.181101 Sep 01 16:35:47.508034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 257/490] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:35:47 2022] POST /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/action => generated 32 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:35:47.518574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:47.519579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:47.525808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.526322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.526759 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.527448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.528072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.528499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.554245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-d42bf153-6abc-4bb6-bebd-f240051d66a1 req-889a62a3-dad9-41a9-a256-626bcb2b0d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "name": "network-vif-plugged", "status": "completed", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:35:47.570036 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-d42bf153-6abc-4bb6-bebd-f240051d66a1 req-889a62a3-dad9-41a9-a256-626bcb2b0d85 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:47.570540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-d42bf153-6abc-4bb6-bebd-f240051d66a1 req-889a62a3-dad9-41a9-a256-626bcb2b0d85 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:47.570970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-d42bf153-6abc-4bb6-bebd-f240051d66a1 req-889a62a3-dad9-41a9-a256-626bcb2b0d85 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:47.582889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-d42bf153-6abc-4bb6-bebd-f240051d66a1 req-889a62a3-dad9-41a9-a256-626bcb2b0d85 service nova] Creating event network-vif-plugged:9934d19e-6301-4c24-8a8b-6d0bf27e8bbd for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 on hv-cinder-85220 Sep 01 16:35:47.590445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-d42bf153-6abc-4bb6-bebd-f240051d66a1 req-889a62a3-dad9-41a9-a256-626bcb2b0d85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040014 Sep 01 16:35:47.591204 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 258/491] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:35:47.667392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:47.675865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a0d260cc-9fbe-4310-91a3-42bd0f01e0b0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.162064 Sep 01 16:35:47.676683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 234/492] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:47 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:48.533042 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:48.533761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:48.540466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.541591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.542030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.542741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.543198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.543620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.671879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.680512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.681942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.683122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6b1f1f90-c2d0-457d-9718-69639eae1bda tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.154552 Sep 01 16:35:48.683674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 259/493] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:48 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:48.698153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:48.698806 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:48.705138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.705607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.706035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.706736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:48.707186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:48.707599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:48.836693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:48.845495 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5b22babe-07d5-452c-8954-fda5e708a53f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.151180 Sep 01 16:35:48.846061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 235/494] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:48 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:49.706906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:49.707505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:49.714782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.715255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.715684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.716385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.716832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.717248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.851050 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:49.859622 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:49.861168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:49.862354 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1f40c121-4238-4312-b527-5c3155893dc2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.160100 Sep 01 16:35:49.862910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 260/495] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:49 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:49.865792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:49.866421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:49.872813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.873290 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.873723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:49.874432 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:49.874934 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:49.875355 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.069332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:50.078236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-15b2539e-c571-4b19-acf7-ec8e5e152695 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.216208 Sep 01 16:35:50.078818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 236/496] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:49 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:35:50.885916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:50.886552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:50.893414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.893414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.893833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:50.894541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:50.895100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:50.895409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.033921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:51.042891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:51.044358 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:51.045540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-19a23b00-fd3d-4498-b187-bc54787f2402 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1808 microversion: 2.20 time: 0.164333 Sep 01 16:35:51.046116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 261/497] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:50 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:51.099403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:51.100004 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:51.107588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.108064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.108521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.109236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:51.109657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:51.110076 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:51.246030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:51.254217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-64a8596b-5a7a-4df3-b15c-d228ad4a9f84 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.158811 Sep 01 16:35:51.254882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 237/498] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:51 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:52.069017 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:52.069621 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:52.076610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:52.077087 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:52.077514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:52.078221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:52.078672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:52.079091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:52.213663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.222149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.223609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.224758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c3c81a97-dd47-41a6-8b02-a206adf569df tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1795 microversion: 2.20 time: 0.159584 Sep 01 16:35:52.225316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 262/499] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:35:52 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1795 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:35:52.275385 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:52.275993 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:52.283335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:52.283818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:52.284255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:52.284945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:52.285402 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:52.285828 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:52.417746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:52.425819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-730eff0a-8f79-46a9-b2f1-34af71e6047d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.154441 Sep 01 16:35:52.426409 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 238/500] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:52 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:53.447957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:53.448587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:53.454988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.455464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.455889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.456567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:53.457014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:53.457432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:53.588122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:53.596665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3f8d84ae-0705-433e-af1a-541c062b8500 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.153129 Sep 01 16:35:53.597238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 263/501] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:53 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:54.619437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:54.620041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:54.626482 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.626958 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.627391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.628073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:54.628531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:54.628953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:54.755862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:54.764421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d33a7929-ca3d-42a0-a9fe-c23c4dabac6a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.148808 Sep 01 16:35:54.764996 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 239/502] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:54 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:55.786791 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:55.787325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:55.794357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.794835 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.795259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.795930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:55.796373 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:55.796787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:55.926832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:55.935559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-93563f1f-2572-4707-9752-c19ec0af6ddc tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.153097 Sep 01 16:35:55.936135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 264/503] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:55 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:56.957159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:56.957778 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:56.964204 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:56.964783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:56.965217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:56.965907 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:56.966397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:56.966822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:57.093302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:57.101640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-af9aaa2d-73d7-4c33-841c-d24976104478 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.148366 Sep 01 16:35:57.102253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 240/504] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:56 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:58.122890 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:58.123500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:58.130016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.130554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.130987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.131673 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:58.132127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:58.132550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:58.263433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:58.271743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b8c70973-09d8-4d75-b6fa-e2e5c123ef4f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.152715 Sep 01 16:35:58.272309 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 265/505] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:58 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:35:59.397188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:35:59.397801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:35:59.405557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.406316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.406978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.408058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:35:59.408844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:35:59.409507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:35:59.542470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:35:59.550879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ffaa9530-234c-4695-bab6-bb1545197a10 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.261583 Sep 01 16:35:59.551462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 241/506] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:35:59 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:00.573370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:00.573954 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:00.576430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=42 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:00.581651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:00.582124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:00.582574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:00.583256 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:00.583698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:00.584112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:00.713958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:00.722693 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bbde18e1-7fff-46aa-a61e-fd0d35aed807 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.153766 Sep 01 16:36:00.723465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 266/507] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:00 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:01.744060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:01.744688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:01.747000 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=42 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:01.752628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.753184 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.753963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.754674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:01.755379 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:01.755803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:01.884347 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:01.892575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-572c4356-7fc2-4a42-803c-181db4470018 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.152313 Sep 01 16:36:01.893151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 242/508] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:01 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:02.914565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:02.915175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:02.921485 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:02.922008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:02.922490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:02.923198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:02.923653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:02.924105 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:03.051844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:03.060599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-427aafac-e32d-44d7-bea8-8f6ebda76bf9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.150006 Sep 01 16:36:03.061165 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 267/509] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:02 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:04.081496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:04.082111 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:04.089465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:04.089947 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:04.090411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:04.091105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:04.091570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:04.091996 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:04.219728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:04.227939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c1ee83a7-1bc3-4081-8f2d-f8a27b629d0d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.150275 Sep 01 16:36:04.228506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 243/510] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:04 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:05.249722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:05.250347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:05.256746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:05.257218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:05.257650 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:05.259002 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:05.259451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:05.259875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:05.385800 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:05.393980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8aadb05c-e824-479d-a465-d64c1aa53169 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.148128 Sep 01 16:36:05.394579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 268/511] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:05 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:36:06.415636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:06.416232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:06.422734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:06.423208 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:06.423635 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:06.424312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:06.424766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:06.425183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:06.551168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:06.560124 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5ea6b3e6-d12c-440e-9214-66e09fa6d0bf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.148276 Sep 01 16:36:06.560636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 244/512] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:06 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:07.581484 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:07.582117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:07.590043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:07.590547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:07.590977 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:07.591668 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:07.592119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:07.592538 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:07.721091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:07.729976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7f228378-cc7f-498d-860b-14c763545dad tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.152360 Sep 01 16:36:07.730562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 269/513] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:07 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:08.750948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:08.751555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:08.758407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:08.758891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:08.759330 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:08.760019 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:08.760482 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:08.761148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:08.887212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:08.896523 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3fb2e3a8-755f-4888-8ce2-6c2567d934cf tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.149495 Sep 01 16:36:08.897104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 245/514] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:08 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:09.918490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:09.919182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:09.921085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:36:09.921317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee (ip 10.222.0.58) !!! Sep 01 16:36:09.928424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:09.928905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:09.929340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:09.930046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:09.930535 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:09.930960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:10.061706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:10.069888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0847509e-fe55-4d15-b3c0-808066d90459 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.155355 Sep 01 16:36:10.070979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 270/515] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:09 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:11.091151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:11.091760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:11.094462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:36:11.094612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:36:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee (ip 10.222.0.58) !!! Sep 01 16:36:11.101221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.101735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.102211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.102911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:11.103392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:11.103819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:11.236946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:11.245668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-925e05b2-e5ab-4833-acd2-e6270ec39d7d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.158458 Sep 01 16:36:11.246470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 246/516] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:11 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:12.267492 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:12.268090 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:12.275114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.275583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.276010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.276682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:12.277129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:12.277559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:12.401795 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:12.410092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0e2811d7-01ca-4e04-b0e5-4e528f31311e tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.146550 Sep 01 16:36:12.410674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 271/517] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:12 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:13.431292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:13.431897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:13.438286 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.438765 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.439197 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.439879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:13.440352 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:13.440859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:13.569817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:13.578629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-add5d1a8-1903-4d68-9f9d-38ffca70ac70 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1735 microversion: 2.1 time: 0.151203 Sep 01 16:36:13.579210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 247/518] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:13 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:14.601246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:14.601782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:14.608206 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.608682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.609110 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.609790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.610260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.610700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.739549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:14.748254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bf86d931-6ce4-4c23-b943-40eece61b73c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1715 microversion: 2.1 time: 0.151159 Sep 01 16:36:14.748817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 272/519] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:14 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:14.808725 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:14.809206 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:14.815770 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.816248 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.816683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.817367 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.817822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.818382 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.950501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] HTTP exception thrown: Cannot 'detach_volume' instance d0adaf7e-e196-4b8a-81d9-71bc129374ee while it is in vm_state rescued Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Request method failure captured: Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments/170b6bff-8bdb-4c11-a231-93d251b5e986 HTTP/1.1 Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5DhGwDvyeVYc1b1IRUjRSH1q6wiRcRqynKksMmmqN4a0CDpF-DZJUtA397BYhFRVZDDgXGvKv5TMTx_L_gv3r_F-P6lFOlhj86IlezydJtu1s-5ElqC0X68Scv7oT5qVe69kHSH-rHyvQ7hkfYxORBgn8nS4FY-phTfpn2VI8Ao8c Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:36:14.952089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27cd65c8d8044dddaf7a761697d216b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}] Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 0d4f8f3a6d42456d8e5cfbe20e54687a Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:36:14.953672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Cannot 'detach_volume' instance d0adaf7e-e196-4b8a-81d9-71bc129374ee while it is in vm_state rescued Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'server_id': 'd0adaf7e-e196-4b8a-81d9-71bc129374ee', 'id': '170b6bff-8bdb-4c11-a231-93d251b5e986'} Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:14.954632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d0adaf7e-e196-4b8a-81d9-71bc129374ee while it is in vm_state rescued Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d0adaf7e-e196-4b8a-81d9-71bc129374ee while it is in vm_state rescued Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:14.956140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Returning 409 to user: Cannot 'detach_volume' instance d0adaf7e-e196-4b8a-81d9-71bc129374ee while it is in vm_state rescued {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:14.957343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-151a701c-d492-4a5b-8823-c10d3e8f0c7b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments/170b6bff-8bdb-4c11-a231-93d251b5e986" status: 409 len: 152 microversion: 2.1 time: 0.149495 Sep 01 16:36:14.957343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 248/520] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:36:14 2022] DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments/170b6bff-8bdb-4c11-a231-93d251b5e986 => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:36:14.962459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:14.962989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:14.968828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.969303 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.969732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:14.970448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:14.970902 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:14.971325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.028829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:15.039631 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4d51c6ba-420c-4b91-87a9-4aafe24240a9 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "POST /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/action" status: 202 len: 0 microversion: 2.1 time: 0.080374 Sep 01 16:36:15.043289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 273/521] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:36:14 2022] POST /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:36:15.048553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:15.049758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:15.056877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.057411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.058009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.058965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:15.059557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:15.059995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:15.190464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:15.193819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:15.199896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0dfcc9e1-b408-497b-b931-6be3f356e975 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1723 microversion: 2.1 time: 0.155223 Sep 01 16:36:15.200479 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 249/522] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:15 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:16.222757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:16.223452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:16.231264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:16.231755 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:16.232187 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.232888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:16.233339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:16.233761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:16.383711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:16.391957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-54684cd2-bb60-45ef-af8b-712a3d0be255 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1723 microversion: 2.1 time: 0.174181 Sep 01 16:36:16.392517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 274/523] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:16 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:17.413931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:17.414575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:17.421191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.421665 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.422090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.422794 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:17.423239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:17.423655 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:17.551261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:17.559449 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-45d92e9a-1ad4-40fd-afc6-5ec43e4c2150 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1723 microversion: 2.1 time: 0.149355 Sep 01 16:36:17.560020 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 250/524] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:17 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:18.581419 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:18.581970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:18.588638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.589136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.589637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.590423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:18.590917 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:18.591355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:18.722603 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:18.731431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f46afea5-9186-4ca2-ae72-1474f8e5c151 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1723 microversion: 2.1 time: 0.153974 Sep 01 16:36:18.731989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 275/525] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:18 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:19.753976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:19.755022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:19.763062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:19.763586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:19.764021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:19.764717 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:19.765170 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:19.765590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:19.896143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:19.904820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b2e13ced-ddd1-4c0d-bae5-ba2bf036bc6d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1723 microversion: 2.1 time: 0.155598 Sep 01 16:36:19.905393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 251/526] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:19 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:20.926362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:20.926964 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:20.933477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.933953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.934436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:20.935113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:20.935567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:20.935986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.061170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:21.069324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-da4e352a-c134-458f-a59e-44630856f946 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1729 microversion: 2.1 time: 0.146833 Sep 01 16:36:21.070430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 276/527] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:20 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:21.090607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:21.091115 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:21.097547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.098035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.098522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.099209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:21.099669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:21.100101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:21.175513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e7cdedca-02d1-443c-8ffd-c6e5d5c0818b tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088785 Sep 01 16:36:21.176116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 252/528] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:36:21 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:22.252949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-5789e268-8c09-41cc-a710-2d8a9e27ad03 req-ec8f4fcb-c3c2-4536-a714-6e1002162c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0adaf7e-e196-4b8a-81d9-71bc129374ee", "tag": "ec332dc9-16e4-4644-9018-718ca145c843"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:22.264102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5789e268-8c09-41cc-a710-2d8a9e27ad03 req-ec8f4fcb-c3c2-4536-a714-6e1002162c2f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:22.264701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5789e268-8c09-41cc-a710-2d8a9e27ad03 req-ec8f4fcb-c3c2-4536-a714-6e1002162c2f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:22.265129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-5789e268-8c09-41cc-a710-2d8a9e27ad03 req-ec8f4fcb-c3c2-4536-a714-6e1002162c2f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:22.276476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-5789e268-8c09-41cc-a710-2d8a9e27ad03 req-ec8f4fcb-c3c2-4536-a714-6e1002162c2f service nova] Creating event network-changed:ec332dc9-16e4-4644-9018-718ca145c843 for instance d0adaf7e-e196-4b8a-81d9-71bc129374ee on hv-cinder-85220 Sep 01 16:36:22.284172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-5789e268-8c09-41cc-a710-2d8a9e27ad03 req-ec8f4fcb-c3c2-4536-a714-6e1002162c2f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034787 Sep 01 16:36:22.284777 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 277/529] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:36:24.353747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-fa0d6b79-31d5-4692-967b-a7e10a160082 req-29af9322-bdad-4c0b-80e8-657c4b90649f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0adaf7e-e196-4b8a-81d9-71bc129374ee", "tag": "ec332dc9-16e4-4644-9018-718ca145c843"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:24.363202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-fa0d6b79-31d5-4692-967b-a7e10a160082 req-29af9322-bdad-4c0b-80e8-657c4b90649f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:24.363676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-fa0d6b79-31d5-4692-967b-a7e10a160082 req-29af9322-bdad-4c0b-80e8-657c4b90649f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:24.364105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-fa0d6b79-31d5-4692-967b-a7e10a160082 req-29af9322-bdad-4c0b-80e8-657c4b90649f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:24.375055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-fa0d6b79-31d5-4692-967b-a7e10a160082 req-29af9322-bdad-4c0b-80e8-657c4b90649f service nova] Creating event network-changed:ec332dc9-16e4-4644-9018-718ca145c843 for instance d0adaf7e-e196-4b8a-81d9-71bc129374ee on hv-cinder-85220 Sep 01 16:36:24.380017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-fa0d6b79-31d5-4692-967b-a7e10a160082 req-29af9322-bdad-4c0b-80e8-657c4b90649f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085418 Sep 01 16:36:24.380602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 253/530] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:56.049134 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=23 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:56.049585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=20 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:56.108756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.109342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.116017 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.116590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.117028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.117714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.118168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.118617 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.142729 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c01a29ff-55b9-4e2c-ad8d-19298bc97f24 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/ips" status: 200 len: 149 microversion: 2.1 time: 0.096495 Sep 01 16:36:56.143278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 278/531] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/ips => generated 149 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:36:56.156615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd7afa02-b86b-4de7-9d27-5ef0ed5c391a"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:56.159067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.161188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=23 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:56.161991 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=18 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:36:56.169054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.169544 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.169985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.170748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.171331 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.171762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.251682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Invalid volume: volume cd7afa02-b86b-4de7-9d27-5ef0ed5c391a is already attached to instances: 6f025a61-b696-4513-bf6f-c598683e0740 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: POST /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/os-volume_attachments HTTP/1.1 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 74 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:36:56.253446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {"volumeAttachment": {"volumeId": "cd7afa02-b86b-4de7-9d27-5ef0ed5c391a"}} Sep 01 16:36:56.255786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Invalid volume: volume cd7afa02-b86b-4de7-9d27-5ef0ed5c391a is already attached to instances: 6f025a61-b696-4513-bf6f-c598683e0740 Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'server_id': '9fb4c143-3275-49a0-8082-844006bf4340', 'body': {'volumeAttachment': {'volumeId': 'cd7afa02-b86b-4de7-9d27-5ef0ed5c391a'}}} Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cd7afa02-b86b-4de7-9d27-5ef0ed5c391a is already attached to instances: 6f025a61-b696-4513-bf6f-c598683e0740 Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:56.256668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cd7afa02-b86b-4de7-9d27-5ef0ed5c391a is already attached to instances: 6f025a61-b696-4513-bf6f-c598683e0740 Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:36:56.257931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cd7afa02-b86b-4de7-9d27-5ef0ed5c391a is already attached to instances: 6f025a61-b696-4513-bf6f-c598683e0740 Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 400 to user: Invalid volume: volume cd7afa02-b86b-4de7-9d27-5ef0ed5c391a is already attached to instances: 6f025a61-b696-4513-bf6f-c598683e0740 {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ea9bf95f-bd63-4ffe-8641-499bea49ea87 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103102 Sep 01 16:36:56.259378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 254/532] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:36:56 2022] POST /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:36:56.264640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.265134 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.271236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.271716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.272145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.272826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.273277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.273705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.298750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:36:56.383476 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-aafe458a-4514-4822-b396-1262a4a6bf09 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 204 len: 0 microversion: 2.1 time: 0.122293 Sep 01 16:36:56.384172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 279/533] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:36:56 2022] DELETE /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:36:56.395619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:56.396229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:56.403174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.403656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.404086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.404771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:56.405222 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:56.405639 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:56.532413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:56.540583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-41dfd025-57f1-49df-b305-2eb99a9d677f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1681 microversion: 2.1 time: 0.150873 Sep 01 16:36:56.541148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 255/534] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:56 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:57.562751 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:57.563612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:57.571153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.571808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.572231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.572925 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:57.573368 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:57.573980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:57.701525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:57.709707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-79a7b68c-6ff5-45ef-a21c-d4ed7c407c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1681 microversion: 2.1 time: 0.151260 Sep 01 16:36:57.710281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 280/535] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:57 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:58.730399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:36:58.731009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:36:58.737497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.737971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.738446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.739129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:58.739584 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:58.740006 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:58.998243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:36:59.006491 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5abf2575-0137-49b8-9c2a-fda2b597ef9a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1681 microversion: 2.1 time: 0.279981 Sep 01 16:36:59.016122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 256/536] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:36:58 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:36:59.704139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-a3c0c65a-2243-497f-a84f-31d1a6853701 req-4d1784f3-f8fb-4a28-9515-e36d785c05bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fb4c143-3275-49a0-8082-844006bf4340", "name": "network-vif-deleted", "tag": "cf351347-f64c-4e7c-97ec-1df7882305a5"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:36:59.716561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a3c0c65a-2243-497f-a84f-31d1a6853701 req-4d1784f3-f8fb-4a28-9515-e36d785c05bc service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:36:59.718844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a3c0c65a-2243-497f-a84f-31d1a6853701 req-4d1784f3-f8fb-4a28-9515-e36d785c05bc service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:36:59.718844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a3c0c65a-2243-497f-a84f-31d1a6853701 req-4d1784f3-f8fb-4a28-9515-e36d785c05bc service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:36:59.730257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-a3c0c65a-2243-497f-a84f-31d1a6853701 req-4d1784f3-f8fb-4a28-9515-e36d785c05bc service nova] Creating event network-vif-deleted:cf351347-f64c-4e7c-97ec-1df7882305a5 for instance 9fb4c143-3275-49a0-8082-844006bf4340 on hv-cinder-85220 Sep 01 16:36:59.736180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-a3c0c65a-2243-497f-a84f-31d1a6853701 req-4d1784f3-f8fb-4a28-9515-e36d785c05bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035580 Sep 01 16:36:59.737044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 281/537] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:00.028316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:00.028923 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:00.035853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.036363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.036789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.037539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.038001 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.038504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.089271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:00.089862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:00.090401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:00.090925 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lazy-loading 'fault' on Instance uuid 9fb4c143-3275-49a0-8082-844006bf4340 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:00.136701 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:00.144445 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-93d90cbe-b84a-48d6-b9f8-835f8d60e171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 200 len: 1331 microversion: 2.1 time: 0.120243 Sep 01 16:37:00.145693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 257/538] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:00 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:01.166917 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.174816 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.183750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.184231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.184815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.185518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.185973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.186423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.200174 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 HTTP/1.1 Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:37:01.201769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:37:01.203383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '9fb4c143-3275-49a0-8082-844006bf4340'} Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:01.204242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:37:01.205465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:01.206590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:01.206590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5d439d1d-63c6-40f6-bf00-765cd7f8b4b1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 404 len: 111 microversion: 2.1 time: 0.040697 Sep 01 16:37:01.206590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 282/539] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:01 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:01.212008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f7fc692a-7aef-4c09-941b-9611ba31d05e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '.version_select at 0x7f6c9cdb7790>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.232232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f7fc692a-7aef-4c09-941b-9611ba31d05e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-200806085" status: 202 len: 0 microversion: 2.1 time: 0.023987 Sep 01 16:37:01.232954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 258/540] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Sep 1 16:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-200806085 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:01.863679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:01.864165 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:01.870074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.870584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.871013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.871692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:01.872143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:01.872564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:01.996657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lazy-loading 'services' on Instance uuid 6f025a61-b696-4513-bf6f-c598683e0740 {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:02.111478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6a523f25-92a1-45c2-853b-d4bbd9838ccd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments/cd7afa02-b86b-4de7-9d27-5ef0ed5c391a" status: 202 len: 0 microversion: 2.1 time: 0.251591 Sep 01 16:37:02.112095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 283/541] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:37:01 2022] DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments/cd7afa02-b86b-4de7-9d27-5ef0ed5c391a => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:02.121123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:02.123236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:02.130553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.131184 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.131624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.132456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:02.132916 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:02.133338 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:02.166544 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-564bc0b6-53a3-4eae-99b7-934895b10100 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049051 Sep 01 16:37:02.167229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 259/542] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:02 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:03.180379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:03.182740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:03.188904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.189380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.189814 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.190526 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:03.190982 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:03.191406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:03.221602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-00a1da84-e566-47a0-8d99-b822be6eff1c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046024 Sep 01 16:37:03.222234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 284/543] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:03 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:04.233796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.235956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.243156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.243642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.244073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.244757 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.245207 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.245711 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.274256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-30ab7dd9-4675-4202-827f-155860297e3a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044425 Sep 01 16:37:04.274812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 260/544] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:37:04.337683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.338257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.344947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.345457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.345894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.346625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.347082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.347505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.372673 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:04.445290 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5543604e-6077-4fb5-9a06-a5971c2a2bde tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 204 len: 0 microversion: 2.1 time: 0.111199 Sep 01 16:37:04.445873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 285/545] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:04 2022] DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:04.454097 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:04.454806 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:04.461195 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.461673 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.462105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.462834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:04.463306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:04.463715 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:04.596337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:04.604245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f63a33b6-67c6-4323-a568-3e6f6fcd78c6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1681 microversion: 2.1 time: 0.154165 Sep 01 16:37:04.604815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 261/546] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:04 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:05.625351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:05.626042 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:05.632909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.633378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.633803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.634505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:05.634952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:05.635383 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:05.763782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:05.771462 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-62b542da-73a8-4bfb-acce-36f789b8dd48 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1681 microversion: 2.1 time: 0.150248 Sep 01 16:37:05.772033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 286/547] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:05 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:06.792744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:06.793978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:06.800557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.801062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.801497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.802209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:06.802705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:06.803158 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:06.885896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:06.893749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d29588eb-8273-496a-b01d-b42d8e012e21 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1613 microversion: 2.1 time: 0.104897 Sep 01 16:37:06.894355 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 262/548] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:06 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:07.109696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-acea12fb-d606-47c4-9c38-22ed3fdcbe04 req-8baf36f6-6360-403d-9b6e-21a01bb8fe48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f025a61-b696-4513-bf6f-c598683e0740", "name": "network-vif-deleted", "tag": "bdb2ff86-ad10-430d-982b-7a22e1a58447"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:07.125879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-acea12fb-d606-47c4-9c38-22ed3fdcbe04 req-8baf36f6-6360-403d-9b6e-21a01bb8fe48 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.126550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-acea12fb-d606-47c4-9c38-22ed3fdcbe04 req-8baf36f6-6360-403d-9b6e-21a01bb8fe48 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.127080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-acea12fb-d606-47c4-9c38-22ed3fdcbe04 req-8baf36f6-6360-403d-9b6e-21a01bb8fe48 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.149113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-acea12fb-d606-47c4-9c38-22ed3fdcbe04 req-8baf36f6-6360-403d-9b6e-21a01bb8fe48 service nova] Creating event network-vif-deleted:bdb2ff86-ad10-430d-982b-7a22e1a58447 for instance 6f025a61-b696-4513-bf6f-c598683e0740 on hv-cinder-85220 Sep 01 16:37:07.157626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-acea12fb-d606-47c4-9c38-22ed3fdcbe04 req-8baf36f6-6360-403d-9b6e-21a01bb8fe48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052505 Sep 01 16:37:07.158256 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 287/549] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:07.917365 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:07.918063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:07.925832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.927075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.927748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.928760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.929301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.929783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.967608 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:07.968125 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:07.968616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:07.969058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lazy-loading 'fault' on Instance uuid 6f025a61-b696-4513-bf6f-c598683e0740 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:08.018610 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:08.026675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ccaef7da-9d59-4673-ae92-d22134deb818 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 200 len: 1331 microversion: 2.1 time: 0.113875 Sep 01 16:37:08.027336 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 263/550] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:07 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:09.049348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.050043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:09.056985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.057485 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.057916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.058626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:09.059076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:09.059490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:09.073135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 HTTP/1.1 Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:37:09.074750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:37:09.076248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '6f025a61-b696-4513-bf6f-c598683e0740'} Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:09.077181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:37:09.078706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:09.080166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:09.080166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e164405c-9710-4d74-bf19-499eed9969d7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 404 len: 111 microversion: 2.1 time: 0.030937 Sep 01 16:37:09.080166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 288/551] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:09 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:37:09.085336 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6c974347-b190-480f-aa14-43a520576f6b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '.version_select at 0x7f6c9ce7d700>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:09.104824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6c974347-b190-480f-aa14-43a520576f6b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529192931" status: 202 len: 0 microversion: 2.1 time: 0.023830 Sep 01 16:37:09.105487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 264/552] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Sep 1 16:37:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529192931 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:37:09.740312 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-93f0a5e2-162d-494f-b906-e27adca06819 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: .version_select at 0x7f6c9cd04430>, body: {"keypair": {"name": "tempest-keypair-1516437458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDDDGcanEWQaj77lzEduuGHRex8G9sMz7AcaHiRonWgp+6LkkkgeKnpyS0daGwS10EMWoW+oodmWy0GnMQpK97YpDllEFPq/dG8cmj5ORzyrCcsea0i/+386dR+Iwca//Q=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:09.756228 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-93f0a5e2-162d-494f-b906-e27adca06819 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:09.760301 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-93f0a5e2-162d-494f-b906-e27adca06819 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:09.788333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-93f0a5e2-162d-494f-b906-e27adca06819 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051876 Sep 01 16:37:09.788924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 289/553] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:37:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:10.921457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-689426651", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56174d1-438e-442e-9134-7098a8e04072"}], "security_groups": [{"name": "tempest-securitygroup--1181224595"}], "key_name": "tempest-keypair-1516437458", "user_data": "}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:10.967458 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:10.968376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:10.975705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.976217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.976672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:10.977476 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:10.977875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:10.978427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.035833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] validate_networks() for [('b56174d1-438e-442e-9134-7098a8e04072', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:37:11.068098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lazy-loading 'services' on Instance uuid 6a5bd3ba-2902-4456-a6f9-0f43241577ae {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:11.189524 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5f0dff2d-ff6f-4ffd-93f8-85e172473298 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-volume_attachments/c28b0de5-d460-41dc-9fd2-e8c4e9dd78b7" status: 202 len: 0 microversion: 2.1 time: 0.329210 Sep 01 16:37:11.190119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 265/554] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:37:10 2022] DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-volume_attachments/c28b0de5-d460-41dc-9fd2-e8c4e9dd78b7 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:11.470590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:37:11.471008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:37:11.471474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:37:11.471876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:37:11.472790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:37:11.481410 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.481885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.482373 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.483099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:11.483550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:11.483970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:11.501378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:11.505345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:11.516601 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:37:11.518936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:37:11.566944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e75635fb-ffac-4c4a-ba21-4c360a26e956 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.650362 Sep 01 16:37:11.567577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 290/555] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:37:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 16:37:11.578801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e04f6d52-1c75-4e18-ba38-be11d832f518 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:11.579506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e04f6d52-1c75-4e18-ba38-be11d832f518 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:11.632792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e04f6d52-1c75-4e18-ba38-be11d832f518 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:11.639777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e04f6d52-1c75-4e18-ba38-be11d832f518 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1241 microversion: 2.1 time: 0.065174 Sep 01 16:37:11.640355 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 266/556] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:11 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:12.660969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:12.661577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:12.667731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.668200 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.668625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.669301 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:12.669747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:12.670161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:12.733717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:12.741459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e88c5f3d-b4ad-4c8e-99d6-8967d89d31d4 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1293 microversion: 2.1 time: 0.084835 Sep 01 16:37:12.742113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 291/557] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:12 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:13.369306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5dc215bd-f821-4e98-97c3-e686067d3db0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:13.379412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5dc215bd-f821-4e98-97c3-e686067d3db0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.379901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5dc215bd-f821-4e98-97c3-e686067d3db0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.380339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5dc215bd-f821-4e98-97c3-e686067d3db0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.402549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5dc215bd-f821-4e98-97c3-e686067d3db0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Going to try to stop instance {{(pid=120693) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 16:37:13.446734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5dc215bd-f821-4e98-97c3-e686067d3db0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action" status: 202 len: 0 microversion: 2.1 time: 0.081001 Sep 01 16:37:13.447384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 267/558] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:37:13 2022] POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:13.456106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:13.456829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.464781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.465681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.466277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.467356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.467896 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.468445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.668158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.676998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-dede11af-07a0-416e-976e-484d132d8560 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.225281 Sep 01 16:37:13.677584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 292/559] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:13 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:13.762632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:13.763721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:13.770051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.770648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.771147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.771898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:13.772415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:13.772900 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:13.854321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:13.862213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5cc286a0-f9a0-4b3b-808e-3346043b31b7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1299 microversion: 2.1 time: 0.104326 Sep 01 16:37:13.863726 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 268/560] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:13 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:14.514632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-aaf4ca45-d279-4624-8bbd-19aa90a5b2a6 req-ef06303c-637e-49c5-a36f-6af060b8981a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a859d3d7-ed03-4ba3-a475-9752cfb9e0bd", "tag": "1702b6a3-03a5-4b50-ac27-255919849285"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:14.526657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-aaf4ca45-d279-4624-8bbd-19aa90a5b2a6 req-ef06303c-637e-49c5-a36f-6af060b8981a service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.527293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-aaf4ca45-d279-4624-8bbd-19aa90a5b2a6 req-ef06303c-637e-49c5-a36f-6af060b8981a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.528119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-aaf4ca45-d279-4624-8bbd-19aa90a5b2a6 req-ef06303c-637e-49c5-a36f-6af060b8981a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.540145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-aaf4ca45-d279-4624-8bbd-19aa90a5b2a6 req-ef06303c-637e-49c5-a36f-6af060b8981a service nova] Creating event network-changed:1702b6a3-03a5-4b50-ac27-255919849285 for instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd on hv-cinder-85220 Sep 01 16:37:14.545277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-aaf4ca45-d279-4624-8bbd-19aa90a5b2a6 req-ef06303c-637e-49c5-a36f-6af060b8981a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Sep 01 16:37:14.546040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 293/561] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:14.698811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.699442 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.705992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.706513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.706955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.707661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.708119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.708546 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.886008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:14.886730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:14.892896 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.893379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.893818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.895005 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:14.895621 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:14.896087 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:14.919538 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:14.928381 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-475e895e-8358-4c37-bd26-0e5c59f5b46e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.233290 Sep 01 16:37:14.929110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 269/562] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:15.101675 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:15.109832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6bc6fca3-d23d-4e4f-8a4c-c1c4ab41d36f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.228417 Sep 01 16:37:15.110545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 294/563] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:14 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:15.950045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:15.950685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:15.957859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.958395 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.958824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:15.959506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:15.959961 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:15.960382 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.131818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:16.132446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:16.139116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.139598 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.140028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.140730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:16.141172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:16.141582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:16.383817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:16.386963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:16.390547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:16.391761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-29c1cfcd-74c1-4a73-ad82-2e6719d4ef63 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.445439 Sep 01 16:37:16.392477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 270/564] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:15 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:16.396057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-05018a51-abcc-4e65-b8ee-d3e7b738352f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.268674 Sep 01 16:37:16.396619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 295/565] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:16 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:17.413280 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:17.413890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:17.416499 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:17.417285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:17.421150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.421471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.421914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.422646 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.423105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.423526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.425159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.425638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.426065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.426779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:17.427254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:17.427676 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:17.428155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:17.624641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.627742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:17.633075 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d9448e9c-8de4-48eb-9eea-af62a8f12171 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.220428 Sep 01 16:37:17.633906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 296/566] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:17 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:17.636553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-04852b8a-4e74-4f00-b72c-e64aa0296515 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.227118 Sep 01 16:37:17.637223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 271/567] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:17 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:18.655034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:18.655773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:18.658467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:18.659193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:18.663567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.664058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.664497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.665226 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.665824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.666275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.666526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.667124 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.667567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.668269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:18.668879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:18.669307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:18.950218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.958341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8c1877b2-e9ee-45ed-90c3-33d708ec4765 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.307667 Sep 01 16:37:18.958934 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 297/568] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:18 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:18.969116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:18.977212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cedeaf51-8b4b-49f5-96e4-b890f51f6d6c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.322775 Sep 01 16:37:18.977798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 272/569] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:18 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:19.978603 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:19.979333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:19.985845 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.986356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.986791 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.987513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:19.987965 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:19.988382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:19.998360 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:19.999048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:20.005318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.005656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.006061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.007083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:20.007682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:20.008095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:20.188343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.197770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7195895d-532e-46fb-88fa-c5de050a61fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.222875 Sep 01 16:37:20.198854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 298/570] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:19 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:20.200295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:20.208647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c216bdc4-aaff-4abe-b4a0-f8a76b5666a0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.214081 Sep 01 16:37:20.209218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 273/571] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:19 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:21.219751 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:21.220366 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.227153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.227633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.228066 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.228754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.228905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:21.229390 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.229505 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:21.229607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.236071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.236535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.237022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.237722 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:21.238178 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:21.238632 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:21.428869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.432386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:21.436681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9be90fff-cbe6-4848-9c1c-9b38e9534dc2 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.220737 Sep 01 16:37:21.437251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 299/572] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:21 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:21.440962 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a0291e81-80ca-4cd6-b7e5-bfcfdc0c440e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.215086 Sep 01 16:37:21.441575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 274/573] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:21 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:22.117722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:22.118653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=10 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:22.175514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-7e17ed44-a6c6-46a3-b3db-de5714c82d0a req-f5045631-4fd0-4eab-b837-e12deee87677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a859d3d7-ed03-4ba3-a475-9752cfb9e0bd", "name": "network-vif-plugged", "status": "completed", "tag": "1702b6a3-03a5-4b50-ac27-255919849285"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:22.185210 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-7e17ed44-a6c6-46a3-b3db-de5714c82d0a req-f5045631-4fd0-4eab-b837-e12deee87677 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.185684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-7e17ed44-a6c6-46a3-b3db-de5714c82d0a req-f5045631-4fd0-4eab-b837-e12deee87677 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.186106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-7e17ed44-a6c6-46a3-b3db-de5714c82d0a req-f5045631-4fd0-4eab-b837-e12deee87677 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.204728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-7e17ed44-a6c6-46a3-b3db-de5714c82d0a req-f5045631-4fd0-4eab-b837-e12deee87677 service nova] Creating event network-vif-plugged:1702b6a3-03a5-4b50-ac27-255919849285 for instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd on hv-cinder-85220 Sep 01 16:37:22.209809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-7e17ed44-a6c6-46a3-b3db-de5714c82d0a req-f5045631-4fd0-4eab-b837-e12deee87677 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096529 Sep 01 16:37:22.210438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 300/574] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:22.458858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:22.459472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:22.463007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:22.464333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:22.465319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:22.468484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.468967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.469831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.470584 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.471469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.473657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.473891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.474355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.475184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.475639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.476235 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.673301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.676799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:22.682046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6b3e3efa-2a8a-419f-ba72-1e3e5a77160b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.227462 Sep 01 16:37:22.682658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 275/575] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:22 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:22.684647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3ce1754b-0945-40f6-bf18-05588cca2b24 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.225957 Sep 01 16:37:22.685284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 301/576] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:22 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:22.803541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:22.804040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:22.809901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.810405 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.810846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.811535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.811998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.812424 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.841473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7c4ad428-f6fc-4c6e-a306-927649c488cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments/4afb5ebd-f102-4a91-95c3-02543b11ff91" status: 200 len: 194 microversion: 2.20 time: 0.138172 Sep 01 16:37:22.842036 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 276/577] 10.222.0.58 () {60 vars in 1454 bytes} [Thu Sep 1 16:37:22 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments/4afb5ebd-f102-4a91-95c3-02543b11ff91 => generated 194 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:22.908357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:22.908850 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:22.914960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.915448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.915880 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.916564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:22.917014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:22.917431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:22.997533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lazy-loading 'services' on Instance uuid 12bc543d-2b3a-4cf9-a341-42e36cea6368 {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:23.069314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9e2af308-ca31-4fc3-9b14-3f426112a28a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments/4afb5ebd-f102-4a91-95c3-02543b11ff91" status: 202 len: 0 microversion: 2.20 time: 0.164722 Sep 01 16:37:23.069921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 302/578] 10.222.0.58 () {60 vars in 1457 bytes} [Thu Sep 1 16:37:22 2022] DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments/4afb5ebd-f102-4a91-95c3-02543b11ff91 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:23.079067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:23.081316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:23.087636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.088115 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.088617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.089884 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.090376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.090799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.121059 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-01ac43c4-b410-47c1-9a97-59607b986980 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046683 Sep 01 16:37:23.121622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 277/579] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Sep 1 16:37:23 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:23.704292 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:23.704998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:23.706225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:23.706867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:23.711976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.712461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.712921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.713202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.713615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.713718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.714088 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.714217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.714540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.714796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:23.715256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:23.715681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:23.911644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.914666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:23.919491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0c070d0f-f214-4630-b058-202f03ab8bc8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1367 microversion: 2.1 time: 0.220076 Sep 01 16:37:23.920277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 303/580] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:23 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:23.923200 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-67379907-7884-48de-886a-3a5d8781f319 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.221343 Sep 01 16:37:23.923844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 278/581] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:23 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:24.134300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.136600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.142683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.143824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.144259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.144943 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.145400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.145938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.174613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b992c232-8a3e-40dd-a50e-21ce49baa8c1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044404 Sep 01 16:37:24.175167 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 304/582] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:24.940242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.940859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.944813 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:24.945525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:24.947332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.947807 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.948233 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.948927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.949375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.949791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.952234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.952715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.953155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:24.953842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:24.954330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:24.954759 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.141162 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.144356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:25.149084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b43467a3-acdf-4727-a6ae-26875fdeba27 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.207970 Sep 01 16:37:25.149851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 305/583] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:25.152335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-58244a8c-9061-4808-ad63-01a5c4287fad tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1556 microversion: 2.1 time: 0.215909 Sep 01 16:37:25.152896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 279/584] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:24 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:25.172238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.172733 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.179459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.179926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.180351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.181025 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.181688 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.182125 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.186620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:25.188868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:25.195133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.195978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.195978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.196668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:25.197124 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:25.197551 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:25.232402 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-64774ad1-9f07-4873-bae8-9bc98af6bac1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049383 Sep 01 16:37:25.233181 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 280/585] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:37:25.265398 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-110fc29f-03c8-4871-9e79-89b4cd12bfa8 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096822 Sep 01 16:37:25.266002 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 306/586] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:37:25 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:26.171448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.172060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.175404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:26.180528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.181022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.181461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.182185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.182656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.183084 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.209724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-bf2c3193-70f8-4997-9c3c-b4a57f7b7efd req-6b4e8c1f-d8ab-451a-aa6a-e1160fcaa512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a859d3d7-ed03-4ba3-a475-9752cfb9e0bd", "tag": "1702b6a3-03a5-4b50-ac27-255919849285"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:26.214663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:26.224345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-bf2c3193-70f8-4997-9c3c-b4a57f7b7efd req-6b4e8c1f-d8ab-451a-aa6a-e1160fcaa512 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.224832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-bf2c3193-70f8-4997-9c3c-b4a57f7b7efd req-6b4e8c1f-d8ab-451a-aa6a-e1160fcaa512 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.225265 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-bf2c3193-70f8-4997-9c3c-b4a57f7b7efd req-6b4e8c1f-d8ab-451a-aa6a-e1160fcaa512 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.238119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-bf2c3193-70f8-4997-9c3c-b4a57f7b7efd req-6b4e8c1f-d8ab-451a-aa6a-e1160fcaa512 service nova] Creating event network-changed:1702b6a3-03a5-4b50-ac27-255919849285 for instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd on hv-cinder-85220 Sep 01 16:37:26.245467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-bf2c3193-70f8-4997-9c3c-b4a57f7b7efd req-6b4e8c1f-d8ab-451a-aa6a-e1160fcaa512 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041796 Sep 01 16:37:26.246433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 307/587] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:26.251841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.254112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.260247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.260733 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.261171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.261873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.262377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.262802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.294563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-04943af6-8593-4245-ba18-8480fb98f4e4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047003 Sep 01 16:37:26.296092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 308/588] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Sep 1 16:37:26 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:26.354598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.364347 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7830a584-a78a-45ee-9cb6-ff4b4d074bb9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.196654 Sep 01 16:37:26.364939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 281/589] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:26 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:26.366657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.367148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.374033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.375032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.375839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.376553 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.377011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.378023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.404979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:26.489812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d3f434de-a5fb-4b06-8aaf-24326eece86a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 204 len: 0 microversion: 2.20 time: 0.126544 Sep 01 16:37:26.490783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 309/590] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Sep 1 16:37:26 2022] DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 16:37:26.499084 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:26.499837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:26.506080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.506967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.507630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.508600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:26.509154 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:26.509672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:26.646985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.655604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.657057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:26.658306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5e6bc547-eac1-4af3-b777-7fd122797c81 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.163288 Sep 01 16:37:26.659596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 282/591] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:26 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:27.387400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.388090 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.395201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.395674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.396102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.396784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.397229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.397643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.528654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.536274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c738665b-c7e8-4690-8233-37195fbbd96a tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.153058 Sep 01 16:37:27.536832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 310/592] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:27.681089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:27.681732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:27.688365 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.688847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.689282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.689973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:27.690455 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:27.690912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:27.824431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.833207 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.834681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:27.835831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-dff27383-ef93-440e-927a-6d22b3e7d9ab tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.158890 Sep 01 16:37:27.836399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 283/593] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:27 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:28.556867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:28.557494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:28.563873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.564348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.564807 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.565494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.565941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.566393 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.764026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:28.767580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:28.772827 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3861d8d7-9e67-4ac3-9e73-dc7b764d1c09 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1675 microversion: 2.1 time: 0.219807 Sep 01 16:37:28.773399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 311/594] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:28 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:28.858849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:28.859576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:28.866084 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.866663 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.867103 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:28.867799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:28.868255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:28.868682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.328877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.339023 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.340445 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.341613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6477cbd4-67a2-4e27-a25c-ff60ffcbaaa9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1723 microversion: 2.20 time: 0.486689 Sep 01 16:37:29.342165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 284/595] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:28 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:29.794265 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-59cf8974-77cc-4aaf-ab38-f8df290de3d3 req-3d8f2fee-6c06-413f-b430-d17009925c80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12bc543d-2b3a-4cf9-a341-42e36cea6368", "name": "network-vif-deleted", "tag": "9934d19e-6301-4c24-8a8b-6d0bf27e8bbd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:29.803023 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:29.803892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:29.811264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:29.811994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:29.812886 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.813016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-59cf8974-77cc-4aaf-ab38-f8df290de3d3 req-3d8f2fee-6c06-413f-b430-d17009925c80 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:29.813561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-59cf8974-77cc-4aaf-ab38-f8df290de3d3 req-3d8f2fee-6c06-413f-b430-d17009925c80 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:29.813917 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:29.814177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-59cf8974-77cc-4aaf-ab38-f8df290de3d3 req-3d8f2fee-6c06-413f-b430-d17009925c80 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.814401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:29.815027 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:29.827691 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-59cf8974-77cc-4aaf-ab38-f8df290de3d3 req-3d8f2fee-6c06-413f-b430-d17009925c80 service nova] Creating event network-vif-deleted:9934d19e-6301-4c24-8a8b-6d0bf27e8bbd for instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 on hv-cinder-85220 Sep 01 16:37:29.833152 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-59cf8974-77cc-4aaf-ab38-f8df290de3d3 req-3d8f2fee-6c06-413f-b430-d17009925c80 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042664 Sep 01 16:37:29.833821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 312/596] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:29.965595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:29.974574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1d26f0dc-826e-4d6c-944b-f8355927e8a5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1652 microversion: 2.1 time: 0.175136 Sep 01 16:37:29.975165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 285/597] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:29 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1652 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:29.995694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b46970bf-6926-4126-81ce-39394dec86f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:30.006238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b46970bf-6926-4126-81ce-39394dec86f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.007012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b46970bf-6926-4126-81ce-39394dec86f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.008356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b46970bf-6926-4126-81ce-39394dec86f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.045841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b46970bf-6926-4126-81ce-39394dec86f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Going to try to start instance {{(pid=120692) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 16:37:30.095637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b46970bf-6926-4126-81ce-39394dec86f0 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action" status: 202 len: 0 microversion: 2.1 time: 0.104117 Sep 01 16:37:30.096338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 313/598] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:37:29 2022] POST /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:30.104964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.105709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.112661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.113251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.113822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.114495 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.115105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.115702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.327949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.336403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4df63e5d-dd58-4476-9262-efa6a536f2d3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1661 microversion: 2.1 time: 0.235629 Sep 01 16:37:30.339830 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 286/599] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1661 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:37:30.363773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:30.364703 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:30.371351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.371907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.372439 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.373202 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.373720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.374375 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.409647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:30.410121 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:30.410589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:30.411023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lazy-loading 'fault' on Instance uuid 12bc543d-2b3a-4cf9-a341-42e36cea6368 {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:30.455719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.463746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.465193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:30.466409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-affc3aee-6857-46ed-b9fb-709ac746d1ce tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 200 len: 1371 microversion: 2.20 time: 0.106825 Sep 01 16:37:30.466958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 314/600] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:30 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:31.357818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.358402 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.365254 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.365734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.366169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.366874 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.367329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.367753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.489456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.490177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:31.493612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:31.496569 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.497023 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:31.497681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.498117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.498947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:31.499428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:31.499856 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:31.501935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ce02c699-13b7-42ff-93bd-58ea557b3acb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1661 microversion: 2.1 time: 0.148065 Sep 01 16:37:31.503340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 287/601] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1661 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:31.514124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] HTTP exception thrown: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Request method failure captured: Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 HTTP/1.1 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5Fl4ZhRzaelJmb_XXzRs_sKWuyH2SR3XNz4n7-5P9YPstZgUjM-d6MxDFtuSGbzQDQHNkDssUWBCNSbkYdknh9AzAr2UChUPshjBbvwGVqiyGCD4A8Df38NRzo5GwgMn2IYX5waaaU1vQlwA1OfNSxMSCaYt_7ijiYEr96K_7LgD0 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:37:31.515805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10f3ba5ae75246ec9237a7e2305ae32a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}] Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: a328e946d6d4441ca7ecbb3a20d2a611 Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:37:31.517545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '12bc543d-2b3a-4cf9-a341-42e36cea6368'} Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:37:31.519316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:37:31.521024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:37:31.522497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Returning 404 to user: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:37:31.522497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a925bca7-328a-4fe4-b164-9aa100ddcfe4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 404 len: 111 microversion: 2.20 time: 0.032144 Sep 01 16:37:31.522497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 315/602] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:31 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:37:31.526642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f0bbcac7-6261-4e22-95fc-8fa6d7c2a386 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '.version_select at 0x7f6c9cccd700>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:31.546016 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f0bbcac7-6261-4e22-95fc-8fa6d7c2a386 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934576524" status: 204 len: 0 microversion: 2.20 time: 0.023334 Sep 01 16:37:31.546609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 288/603] 10.222.0.58 () {60 vars in 1262 bytes} [Thu Sep 1 16:37:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934576524 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 16:37:32.181864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5fc9551b-61f3-4333-b7f4-66d77e59cfe5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'create', calling method: .version_select at 0x7f6c9ce4c280>, body: {"keypair": {"name": "tempest-keypair-1574445053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0L/dLiyIhgXlRkNcHGUOhZD6hYwIycOKPRcqE5mIcHN+kTAfLclxrm+mdN1Dnzi7Hi9qhZW1cRb2nNyOPty6P6oWtXncsCipJdKyqdz+XIx+v83uS36kRLU6ylOh0hYQ=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:32.196898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-5fc9551b-61f3-4333-b7f4-66d77e59cfe5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:32.200726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-5fc9551b-61f3-4333-b7f4-66d77e59cfe5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for user a328e946d6d4441ca7ecbb3a20d2a611 and project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:32.223753 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5fc9551b-61f3-4333-b7f4-66d77e59cfe5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045727 Sep 01 16:37:32.224344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 316/604] 10.222.0.58 () {62 vars in 1200 bytes} [Thu Sep 1 16:37:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 16:37:32.524765 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:32.525724 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:32.531664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.532131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.532569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.533263 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:32.533718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:32.534142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:32.702837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:32.710645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-687ea07b-2891-426c-af22-8c71f0b50f23 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1665 microversion: 2.1 time: 0.190300 Sep 01 16:37:32.711142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 289/605] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:32 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1665 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:33.491968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1087970243", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "336cacce-0ee7-4670-923c-a066f6157763"}], "security_groups": [{"name": "tempest-securitygroup--1712013100"}], "key_name": "tempest-keypair-1574445053", "user_data": "}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:33.603330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] validate_networks() for [('336cacce-0ee7-4670-923c-a066f6157763', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:37:33.978587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:37:33.979006 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:37:33.979473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:37:33.979872 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:37:33.980274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:37:33.989738 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.990246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.990679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:33.991397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:33.991844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:33.992261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:34.008400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:37:34.012303 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Getting quotas for user a328e946d6d4441ca7ecbb3a20d2a611 and project 10f3ba5ae75246ec9237a7e2305ae32a. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:37:34.022998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:37:34.025232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:37:34.072029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-141b9daa-f760-4d2e-a17f-b40c14eeaa32 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.585833 Sep 01 16:37:34.072683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 317/606] 10.222.0.58 () {62 vars in 1188 bytes} [Thu Sep 1 16:37:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 16:37:34.083331 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-af6a4fb1-3a3a-49c4-b425-e5f380d82edc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:34.083935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-af6a4fb1-3a3a-49c4-b425-e5f380d82edc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:34.138289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af6a4fb1-3a3a-49c4-b425-e5f380d82edc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:34.145661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af6a4fb1-3a3a-49c4-b425-e5f380d82edc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:34.147203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-af6a4fb1-3a3a-49c4-b425-e5f380d82edc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:34.148301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-af6a4fb1-3a3a-49c4-b425-e5f380d82edc tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1282 microversion: 2.20 time: 0.068821 Sep 01 16:37:34.148866 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 290/607] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:34 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:35.171606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:35.172210 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:35.178909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:35.179397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:35.179827 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:35.180510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:35.180958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:35.181376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:35.246044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.254904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.256336 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:35.257454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9e7bc73e-9610-420d-bd75-a11fd24edf7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1334 microversion: 2.20 time: 0.090361 Sep 01 16:37:35.258006 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 318/608] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:35 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1334 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:36.282384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:36.283609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:36.292235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.292876 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.293401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.294268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.294800 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.295351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.561122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.569389 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.570978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:36.572128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-76ca3475-5de1-4516-bfff-79bd754d4b4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.294493 Sep 01 16:37:36.572764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 291/609] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:36 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:36.844947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-f0e2dbfc-4e1a-46fd-8256-4927c324bb4b req-ebd1d080-65ee-49ef-921c-24dffb5605a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:36.854988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-f0e2dbfc-4e1a-46fd-8256-4927c324bb4b req-ebd1d080-65ee-49ef-921c-24dffb5605a3 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:36.855450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-f0e2dbfc-4e1a-46fd-8256-4927c324bb4b req-ebd1d080-65ee-49ef-921c-24dffb5605a3 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:36.855821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-f0e2dbfc-4e1a-46fd-8256-4927c324bb4b req-ebd1d080-65ee-49ef-921c-24dffb5605a3 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:36.866912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-f0e2dbfc-4e1a-46fd-8256-4927c324bb4b req-ebd1d080-65ee-49ef-921c-24dffb5605a3 service nova] Creating event network-changed:526f4514-26c0-4b58-918a-efbcf230a662 for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 on hv-cinder-85220 Sep 01 16:37:36.871847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-f0e2dbfc-4e1a-46fd-8256-4927c324bb4b req-ebd1d080-65ee-49ef-921c-24dffb5605a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030629 Sep 01 16:37:36.872434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 319/610] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:37.595854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:37.596518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:37.603032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.603515 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.603952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.604648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:37.605104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:37.605530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:37.735554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.744130 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.745583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:37.746711 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-921998b2-eda3-41b7-83f4-b691b98dc829 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.154957 Sep 01 16:37:37.747281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 292/611] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:37 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:38.771458 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:38.772156 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:38.779209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.779690 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.780126 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.780814 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:38.781267 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:38.781719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:38.905829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.914472 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.915909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:38.917000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-afc6826f-463a-4bb6-a157-68fc61c543b4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.150375 Sep 01 16:37:38.917571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 320/612] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:38 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:39.939738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:39.940322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:39.946814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.947287 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.947716 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:39.948462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:39.948910 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:39.949326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:40.077941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.086734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.088211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:40.089386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5b67ac7b-da6b-488a-b91c-621e513849de tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.154079 Sep 01 16:37:40.089953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 293/613] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:39 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:41.112021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:41.112674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:41.119153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.119623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.120046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.120727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:41.121169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:41.121582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:41.255688 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.263797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.265285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:41.266459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4f993c43-286b-4344-bdf6-a6e49c7a5a36 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.158358 Sep 01 16:37:41.267541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 321/614] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:41 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:42.289420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:42.289956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:42.296355 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:42.296831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:42.297258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.297935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:42.298437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:42.298858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:42.426808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.434876 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.436332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:42.437414 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-10d92f23-9d57-42d6-ac0f-9c8825737f6a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.151974 Sep 01 16:37:42.437970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 294/615] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:42 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:43.460445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:43.461077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:43.467570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.468117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.468642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.469449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:43.469919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:43.470374 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:43.603318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.612026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.613473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:43.614607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cb9a198f-aff2-40c8-8231-94c1928d3588 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.158049 Sep 01 16:37:43.615171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 322/616] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:43 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:44.615658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-7f449543-71b7-46c6-a984-15b240c8a30e req-84c7d565-93da-4f32-ae00-60725029076e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "name": "network-vif-plugged", "status": "completed", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:44.627598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:44.629595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-7f449543-71b7-46c6-a984-15b240c8a30e req-84c7d565-93da-4f32-ae00-60725029076e service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.630241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-7f449543-71b7-46c6-a984-15b240c8a30e req-84c7d565-93da-4f32-ae00-60725029076e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.630792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-7f449543-71b7-46c6-a984-15b240c8a30e req-84c7d565-93da-4f32-ae00-60725029076e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.637109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:44.637741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:44.644769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:44.645685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-7f449543-71b7-46c6-a984-15b240c8a30e req-84c7d565-93da-4f32-ae00-60725029076e service nova] Creating event network-vif-plugged:526f4514-26c0-4b58-918a-efbcf230a662 for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 on hv-cinder-85220 Sep 01 16:37:44.645841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=10 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:44.651575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-7f449543-71b7-46c6-a984-15b240c8a30e req-84c7d565-93da-4f32-ae00-60725029076e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040307 Sep 01 16:37:44.652463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 295/617] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:44.654639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.655152 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.655838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.656826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:44.657316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:44.657864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:44.788426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.797872 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.799388 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:44.800499 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-342f91e7-0f59-4f34-bff0-41954eba3f2e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.167305 Sep 01 16:37:44.801064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 323/618] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:44 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:45.823951 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:45.824564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:45.831212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.831687 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.832120 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.832801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:45.833260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:45.833683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:45.971126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.983428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.984860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:45.986586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d5ac145e-6493-461b-80e2-7297888d3f64 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.167436 Sep 01 16:37:45.987148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 296/619] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:45 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:47.008955 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:47.009587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:47.015942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.016412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.016839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.017517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:47.017962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:47.018409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:47.148562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.156887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.158372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:47.159474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-161c13f1-7510-4308-bc0a-ce17694db110 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1408 microversion: 2.20 time: 0.154413 Sep 01 16:37:47.160043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 324/620] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:47 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:37:48.181774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:48.182408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:48.189369 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.189847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.190300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.190981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.191424 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.191840 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.331903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.340052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.341539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:48.342723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-74cafb3a-6f1c-4756-adbc-e81e843290f6 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1600 microversion: 2.20 time: 0.164846 Sep 01 16:37:48.343282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 297/621] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:37:48 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1600 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:37:48.364743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:48.365246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:48.371645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.372125 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.372561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.373245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:48.373699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:48.374122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:48.450080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2e91a45c-322c-47a4-958a-0c64c9306016 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089196 Sep 01 16:37:48.450730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 325/622] 10.222.0.58 () {60 vars in 1316 bytes} [Thu Sep 1 16:37:48 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:37:49.370471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-7d3a6952-3703-4550-ae52-c64ed085c10a req-efab84e2-f0d9-48a4-ae4a-ab353e87c565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:37:49.380267 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-7d3a6952-3703-4550-ae52-c64ed085c10a req-efab84e2-f0d9-48a4-ae4a-ab353e87c565 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:49.380858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-7d3a6952-3703-4550-ae52-c64ed085c10a req-efab84e2-f0d9-48a4-ae4a-ab353e87c565 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:49.381353 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-7d3a6952-3703-4550-ae52-c64ed085c10a req-efab84e2-f0d9-48a4-ae4a-ab353e87c565 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:49.392734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-7d3a6952-3703-4550-ae52-c64ed085c10a req-efab84e2-f0d9-48a4-ae4a-ab353e87c565 service nova] Creating event network-changed:526f4514-26c0-4b58-918a-efbcf230a662 for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 on hv-cinder-85220 Sep 01 16:37:49.397793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-7d3a6952-3703-4550-ae52-c64ed085c10a req-efab84e2-f0d9-48a4-ae4a-ab353e87c565 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031179 Sep 01 16:37:49.398426 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 298/623] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:51.847626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:51.848139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:51.854294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.854775 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.855208 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.855891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:51.856347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:51.856769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:51.936703 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'services' on Instance uuid d0adaf7e-e196-4b8a-81d9-71bc129374ee {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:37:52.007333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ee84ed58-8b3e-4e24-b0c9-ac33067894d1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments/170b6bff-8bdb-4c11-a231-93d251b5e986" status: 202 len: 0 microversion: 2.1 time: 0.164280 Sep 01 16:37:52.007926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 326/624] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:37:51 2022] DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments/170b6bff-8bdb-4c11-a231-93d251b5e986 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:37:52.017905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:52.020148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:52.026676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.027159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.027596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.028285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:52.028747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:52.029173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:52.059788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-70ff21b7-5146-438c-9987-8d40e33e1830 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046895 Sep 01 16:37:52.060357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 299/625] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:52 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:37:53.072988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:53.075342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:53.082077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.082618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.083057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.083746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:53.084203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:53.084626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:53.115424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-22a430d0-4dfd-45ef-92ed-b75e53e60934 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047139 Sep 01 16:37:53.116457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 327/626] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:53 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:37:54.128619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.130810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.137337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.137821 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.138315 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.139047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.139559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.140029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.170333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-71e334af-9973-4081-8fa2-bae51717f232 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046012 Sep 01 16:37:54.170892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 300/627] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:37:54 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:37:54.249848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.250428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.256823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.257296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.257722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.258434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.258893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.259311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.286853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:37:54.336640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:54.364431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-15913087-aa5a-47f2-83fc-1479e2e4cd4a tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 204 len: 0 microversion: 2.1 time: 0.118145 Sep 01 16:37:54.365244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 328/628] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:37:54 2022] DELETE /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:37:54.373458 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:54.374059 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:54.380169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.380692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.381365 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.382062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:54.382545 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:54.383126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:54.512320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:54.520823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-795461f6-4c6d-48f7-99ce-990cbb131cce tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1689 microversion: 2.1 time: 0.151396 Sep 01 16:37:54.521394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 301/629] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:54 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:55.542809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:55.543500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:55.549971 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:55.550477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:55.550908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.551588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:55.552036 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:55.552456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:55.683334 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:55.691739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-63eb1516-e137-4f09-b3a5-d3bac6742864 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1689 microversion: 2.1 time: 0.153261 Sep 01 16:37:55.692335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 329/630] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:55 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:56.712659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:56.713193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:56.715723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:56.721052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.721539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.721974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.722702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:56.723157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:56.723585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:56.850113 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:56.858038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8cedc089-aead-4579-8963-4497e89ca8fe tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1689 microversion: 2.1 time: 0.149307 Sep 01 16:37:56.858753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 302/631] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:56 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:57.879819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:57.880454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:57.883147 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:37:57.888504 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.888990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.889426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:57.890115 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:57.890604 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:57.891026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:58.020841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:58.028782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-130bfa13-1624-40fe-bdbe-29a75d6948ed tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1689 microversion: 2.1 time: 0.153611 Sep 01 16:37:58.029347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 330/632] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:57 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:37:59.049823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:37:59.050232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:37:59.057086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.057559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.057993 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.058716 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:37:59.059169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:37:59.059591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:37:59.240157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:37:59.247938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-819b8880-08c4-4a68-b90e-c3b63f894987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1689 microversion: 2.1 time: 0.202784 Sep 01 16:37:59.248514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 303/633] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:37:59 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1689 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:00.271404 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:00.272012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:00.278728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.279209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.279636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.280329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.280779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.281284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.420518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:00.431061 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0b5553ab-83bd-44f0-b50d-762d92101868 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1689 microversion: 2.1 time: 0.163476 Sep 01 16:38:00.431835 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 331/634] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:00 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:00.750560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-45017fee-9989-4d78-a011-3433d3500f02 req-958ce7f2-54ea-4740-a40a-12c099a8a470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0adaf7e-e196-4b8a-81d9-71bc129374ee", "name": "network-vif-deleted", "tag": "ec332dc9-16e4-4644-9018-718ca145c843"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:00.760840 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-45017fee-9989-4d78-a011-3433d3500f02 req-958ce7f2-54ea-4740-a40a-12c099a8a470 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:00.761323 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-45017fee-9989-4d78-a011-3433d3500f02 req-958ce7f2-54ea-4740-a40a-12c099a8a470 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:00.761758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-45017fee-9989-4d78-a011-3433d3500f02 req-958ce7f2-54ea-4740-a40a-12c099a8a470 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:00.781747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-45017fee-9989-4d78-a011-3433d3500f02 req-958ce7f2-54ea-4740-a40a-12c099a8a470 service nova] Creating event network-vif-deleted:ec332dc9-16e4-4644-9018-718ca145c843 for instance d0adaf7e-e196-4b8a-81d9-71bc129374ee on hv-cinder-85220 Sep 01 16:38:00.788871 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-45017fee-9989-4d78-a011-3433d3500f02 req-958ce7f2-54ea-4740-a40a-12c099a8a470 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102059 Sep 01 16:38:00.789492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 304/635] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:01.452356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:01.453686 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:01.460060 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.460541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.461158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.462046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.462579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.463031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.504748 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:01.505236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:01.505667 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:01.506257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'fault' on Instance uuid d0adaf7e-e196-4b8a-81d9-71bc129374ee {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:01.550664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:01.560100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2d15dbd0-feda-431b-9c70-28fdcd309ab2 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 200 len: 1335 microversion: 2.1 time: 0.111177 Sep 01 16:38:01.560957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 332/636] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:01 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 1335 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:02.583663 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.584299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: d0adaf7e-e196-4b8a-81d9-71bc129374ee] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:02.590457 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.590932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.591357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.592032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:02.592597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:02.593022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:02.596311 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=79 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:38:02.607922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] HTTP exception thrown: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee could not be found. Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Request method failure captured: Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee HTTP/1.1 Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5DhGwDvyeVYc1b1IRUjRSH1q6wiRcRqynKksMmmqN4a0CDpF-DZJUtA397BYhFRVZDDgXGvKv5TMTx_L_gv3r_F-P6lFOlhj86IlezydJtu1s-5ElqC0X68Scv7oT5qVe69kHSH-rHyvQ7hkfYxORBgn8nS4FY-phTfpn2VI8Ao8c Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:38:02.610145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27cd65c8d8044dddaf7a761697d216b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}] Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 0d4f8f3a6d42456d8e5cfbe20e54687a Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee could not be found. Sep 01 16:38:02.611793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'd0adaf7e-e196-4b8a-81d9-71bc129374ee'} Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee could not be found. Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:02.612700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee could not be found. Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee could not be found. Sep 01 16:38:02.613970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:38:02.615216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Returning 404 to user: Instance d0adaf7e-e196-4b8a-81d9-71bc129374ee could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:02.615216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3a33d841-ddc8-4e95-8a36-1eee7c05cece tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee" status: 404 len: 111 microversion: 2.1 time: 0.032645 Sep 01 16:38:02.615216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 305/637] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:02 2022] GET /compute/v2.1/servers/d0adaf7e-e196-4b8a-81d9-71bc129374ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:02.620263 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-46b7fb2b-f34a-41d9-b380-f1b5f1a7ee15 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '.version_select at 0x7f6c9cdfd0d0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:02.639245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-46b7fb2b-f34a-41d9-b380-f1b5f1a7ee15 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252816646" status: 202 len: 0 microversion: 2.1 time: 0.022763 Sep 01 16:38:02.639802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 333/638] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Sep 1 16:38:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252816646 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:38:05.641913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:05.642506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:05.649426 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.649902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.650358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.651040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.651489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.651908 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.677173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:38:05.753142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8eaf7942-6998-478a-bf6f-693c22764987 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 204 len: 0 microversion: 2.1 time: 0.114702 Sep 01 16:38:05.753940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 306/639] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:38:05 2022] DELETE /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:38:05.763963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:05.764572 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:05.771269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.771751 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.772182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.773081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:05.773542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:05.773968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:05.908040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:05.915592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-44c20d6c-038b-4f81-9fa1-253d70f67ae1 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1508 microversion: 2.1 time: 0.157326 Sep 01 16:38:05.916148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 334/640] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:05 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:06.937986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:06.938717 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:06.945089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.945568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.946003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:06.946726 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:06.947180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:06.947600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.073235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:07.080972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2690ffe2-6d36-4911-a428-33860dceba9d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1508 microversion: 2.1 time: 0.147823 Sep 01 16:38:07.081531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 307/641] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:06 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:07.613703 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-e2682a42-c08e-45ba-9f13-c628dcad1b79 req-ab763a4a-b147-4ba5-b3cf-798eef2558d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814dbaf0-6089-4980-827b-b9cb5bfc5eda", "name": "network-vif-deleted", "tag": "a4f34254-a6f3-40e7-a19a-2bfbc8a70983"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:07.625051 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-e2682a42-c08e-45ba-9f13-c628dcad1b79 req-ab763a4a-b147-4ba5-b3cf-798eef2558d6 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:07.625552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-e2682a42-c08e-45ba-9f13-c628dcad1b79 req-ab763a4a-b147-4ba5-b3cf-798eef2558d6 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:07.626010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-e2682a42-c08e-45ba-9f13-c628dcad1b79 req-ab763a4a-b147-4ba5-b3cf-798eef2558d6 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:07.637686 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-e2682a42-c08e-45ba-9f13-c628dcad1b79 req-ab763a4a-b147-4ba5-b3cf-798eef2558d6 service nova] Creating event network-vif-deleted:a4f34254-a6f3-40e7-a19a-2bfbc8a70983 for instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda on hv-cinder-85220 Sep 01 16:38:07.643078 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-e2682a42-c08e-45ba-9f13-c628dcad1b79 req-ab763a4a-b147-4ba5-b3cf-798eef2558d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 Sep 01 16:38:07.643691 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 335/642] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:08.102570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:08.103116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:08.110329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.110813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.111285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.111982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.112441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.112866 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.143213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:08.143653 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:08.144069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:08.144510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'fault' on Instance uuid 814dbaf0-6089-4980-827b-b9cb5bfc5eda {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:08.184283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:08.191952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1084ccbe-bbed-4413-a3e7-5b23048bd264 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 200 len: 1312 microversion: 2.1 time: 0.093494 Sep 01 16:38:08.192518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 308/643] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:08 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:09.213900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.214623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: 814dbaf0-6089-4980-827b-b9cb5bfc5eda] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.221326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.221801 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.222270 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.222953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.223400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.223853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.236878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] HTTP exception thrown: Instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda could not be found. Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Request method failure captured: Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda HTTP/1.1 Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5DhGwDvyeVYc1b1IRUjRSH1q6wiRcRqynKksMmmqN4a0CDpF-DZJUtA397BYhFRVZDDgXGvKv5TMTx_L_gv3r_F-P6lFOlhj86IlezydJtu1s-5ElqC0X68Scv7oT5qVe69kHSH-rHyvQ7hkfYxORBgn8nS4FY-phTfpn2VI8Ao8c Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:38:09.238493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27cd65c8d8044dddaf7a761697d216b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}] Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 0d4f8f3a6d42456d8e5cfbe20e54687a Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda could not be found. Sep 01 16:38:09.239983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '814dbaf0-6089-4980-827b-b9cb5bfc5eda'} Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda could not be found. Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:09.241602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda could not be found. Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda could not be found. Sep 01 16:38:09.243085 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:09.244323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Returning 404 to user: Instance 814dbaf0-6089-4980-827b-b9cb5bfc5eda could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:09.244323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-64f6eb8c-8bf0-4e5f-82e8-f9ba37324b4d tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda" status: 404 len: 111 microversion: 2.1 time: 0.030744 Sep 01 16:38:09.244323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 336/644] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/814dbaf0-6089-4980-827b-b9cb5bfc5eda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:38:09.248218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.248710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.256180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.256654 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.257079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.257750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.258214 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.258636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.284564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:38:09.357822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1d779c35-15bf-465b-b059-67291253aa93 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 204 len: 0 microversion: 2.1 time: 0.112946 Sep 01 16:38:09.359076 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 309/645] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:38:09 2022] DELETE /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:38:09.366740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:09.367349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:09.373264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.373740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.374813 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.375514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:09.375976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:09.376393 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:09.507467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:09.515210 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7b69f6e5-41e1-424b-80e0-505b87d0643f tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.152289 Sep 01 16:38:09.515801 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 337/646] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:09 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:38:10.538940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:10.539641 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:10.546697 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.547293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.547728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.548406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:10.548860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:10.549276 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:10.680971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:10.689001 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b477f5e3-b532-49c3-aafe-74630738290c tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.155941 Sep 01 16:38:10.689588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 310/647] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:10 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:11.710873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:11.711488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:11.718159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.718665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.719103 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.719782 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:11.720231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:11.720649 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:11.849007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:11.856744 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5bb3d89e-5d63-41c1-bb27-8803e8c04ce0 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.149730 Sep 01 16:38:11.857365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 338/648] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:11 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:12.878277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:12.878890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:12.885480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.885956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.886435 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:12.887127 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:12.887677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:12.888134 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.013383 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:13.021137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0bfc6fa6-93dc-4e10-9977-3333a57ddbe8 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1522 microversion: 2.1 time: 0.147365 Sep 01 16:38:13.021706 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 311/649] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:12 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:13.641591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-53f1e1f0-b534-4697-9897-f772bc171c09 req-645546cb-5274-4771-829f-4b4b24b3b237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7351def-25a9-4fd3-ab43-54ae606aa063", "name": "network-vif-deleted", "tag": "d0735aec-28ea-4319-9808-1fa1397ad01f"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:38:13.652172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-53f1e1f0-b534-4697-9897-f772bc171c09 req-645546cb-5274-4771-829f-4b4b24b3b237 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:13.652644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-53f1e1f0-b534-4697-9897-f772bc171c09 req-645546cb-5274-4771-829f-4b4b24b3b237 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:13.653069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-53f1e1f0-b534-4697-9897-f772bc171c09 req-645546cb-5274-4771-829f-4b4b24b3b237 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:13.663794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-53f1e1f0-b534-4697-9897-f772bc171c09 req-645546cb-5274-4771-829f-4b4b24b3b237 service nova] Creating event network-vif-deleted:d0735aec-28ea-4319-9808-1fa1397ad01f for instance f7351def-25a9-4fd3-ab43-54ae606aa063 on hv-cinder-85220 Sep 01 16:38:13.668670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-53f1e1f0-b534-4697-9897-f772bc171c09 req-645546cb-5274-4771-829f-4b4b24b3b237 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030795 Sep 01 16:38:13.669241 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 339/650] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:38:14.042670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:14.043584 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:14.050462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.050945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.051386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.052121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.052890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.053316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.085293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:14.085798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:14.086208 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:14.086743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lazy-loading 'fault' on Instance uuid f7351def-25a9-4fd3-ab43-54ae606aa063 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:38:14.127235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d4f8f3a6d42456d8e5cfbe20e54687a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27cd65c8d8044dddaf7a761697d216b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:38:14.134731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b2acb5d8-c7a1-4740-b8c5-86e4af58b015 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 200 len: 1311 microversion: 2.1 time: 0.096361 Sep 01 16:38:14.135301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 312/651] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:14 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:38:15.156794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:38:15.157489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] [instance: f7351def-25a9-4fd3-ab43-54ae606aa063] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:38:15.163656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.164135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.164569 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.165251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:38:15.165704 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:38:15.166126 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:38:15.179551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] HTTP exception thrown: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 could not be found. Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Request method failure captured: Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 HTTP/1.1 Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5DhGwDvyeVYc1b1IRUjRSH1q6wiRcRqynKksMmmqN4a0CDpF-DZJUtA397BYhFRVZDDgXGvKv5TMTx_L_gv3r_F-P6lFOlhj86IlezydJtu1s-5ElqC0X68Scv7oT5qVe69kHSH-rHyvQ7hkfYxORBgn8nS4FY-phTfpn2VI8Ao8c Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:38:15.181111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27cd65c8d8044dddaf7a761697d216b4", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27cd65c8d8044dddaf7a761697d216b4"}]}] Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 27cd65c8d8044dddaf7a761697d216b4 Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1302600782 Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 0d4f8f3a6d42456d8e5cfbe20e54687a Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1302600782-project Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 could not be found. Sep 01 16:38:15.182702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'f7351def-25a9-4fd3-ab43-54ae606aa063'} Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 could not be found. Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:38:15.183488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 could not be found. Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 could not be found. Sep 01 16:38:15.184647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:38:15.185717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] Returning 404 to user: Instance f7351def-25a9-4fd3-ab43-54ae606aa063 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:38:15.185717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c28f5981-21f3-4449-9b55-bd8b2a344055 tempest-ServerRescueNegativeTestJSON-1302600782 tempest-ServerRescueNegativeTestJSON-1302600782-project] 10.222.0.58 "GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063" status: 404 len: 111 microversion: 2.1 time: 0.030408 Sep 01 16:38:15.185717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 340/652] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:38:15 2022] GET /compute/v2.1/servers/f7351def-25a9-4fd3-ab43-54ae606aa063 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:22.725547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.726322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.731183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:22.733375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:22.741246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.741722 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.742149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.742853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.743301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.743756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.775835 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1c0acc78-ee51-428b-99df-e54ff91bea5c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052119 Sep 01 16:39:22.776398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 313/653] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:39:22 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:39:22.835225 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.835958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=52 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:22.840495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:22.840974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:22.847908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.848377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.848803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.849481 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.849928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.850377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.875942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:39:22.948570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-57aafb59-b0da-4856-81a9-26765cfac0dd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 204 len: 0 microversion: 2.1 time: 0.114879 Sep 01 16:39:22.949244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 341/654] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:39:22 2022] DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:39:22.957574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:22.958285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:22.964717 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.965198 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.965635 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:22.966357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:22.966822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:22.967246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:23.097423 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:23.105730 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e464b4b3-7d60-4760-9c7c-363332244e6e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1671 microversion: 2.1 time: 0.152152 Sep 01 16:39:23.108521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 314/655] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:22 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:24.127797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:24.128500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:24.135119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.135598 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.136034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.136724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:24.137178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:24.137600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:24.271968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:24.284713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-80114122-bd81-4760-bb35-4355f6cb0359 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1671 microversion: 2.1 time: 0.161036 Sep 01 16:39:24.285300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 342/656] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:24 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:39:25.307612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:25.308157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:25.314733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.315211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.315646 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.316324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:25.316779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:25.317204 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:25.452192 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:25.459976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-80112ab7-2ced-48b7-b334-20971202e290 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1671 microversion: 2.1 time: 0.156786 Sep 01 16:39:25.462244 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 315/657] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:25 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:26.226377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-9da24c43-76a9-4147-adb2-47246dc66255 req-d3bcc55d-12e3-4cbf-9345-3f607dd176c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a5bd3ba-2902-4456-a6f9-0f43241577ae", "name": "network-vif-deleted", "tag": "a193b26d-37c2-41b3-a5b3-f879211927f9"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:26.239215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9da24c43-76a9-4147-adb2-47246dc66255 req-d3bcc55d-12e3-4cbf-9345-3f607dd176c2 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.239698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9da24c43-76a9-4147-adb2-47246dc66255 req-d3bcc55d-12e3-4cbf-9345-3f607dd176c2 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.240128 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9da24c43-76a9-4147-adb2-47246dc66255 req-d3bcc55d-12e3-4cbf-9345-3f607dd176c2 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.251863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-9da24c43-76a9-4147-adb2-47246dc66255 req-d3bcc55d-12e3-4cbf-9345-3f607dd176c2 service nova] Creating event network-vif-deleted:a193b26d-37c2-41b3-a5b3-f879211927f9 for instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae on hv-cinder-85220 Sep 01 16:39:26.256769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-9da24c43-76a9-4147-adb2-47246dc66255 req-d3bcc55d-12e3-4cbf-9345-3f607dd176c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034167 Sep 01 16:39:26.257364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 343/658] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:26.481621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:26.482257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:26.488628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.489110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.489545 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.490262 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:26.490725 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:26.491155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:26.555987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:26.564003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f7cd2cfe-08fd-44c1-8692-d0c07b28eebb tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1604 microversion: 2.1 time: 0.086898 Sep 01 16:39:26.564578 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 316/659] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:26 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1604 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:27.585552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:27.586143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:27.592722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.593193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.593610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.594318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:27.594771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:27.595182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:27.656608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:27.664203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f869aea6-dedc-4fe6-916a-e120045ab9ae tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1604 microversion: 2.1 time: 0.082956 Sep 01 16:39:27.664774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 344/660] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:27 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1604 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:28.684976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:28.685640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:28.692565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.693050 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.693488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.694220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:28.694696 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:28.695122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:28.765815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:28.773817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8e0aa7f3-ef36-4081-a96c-9160a8c2adc5 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1321 microversion: 2.1 time: 0.092792 Sep 01 16:39:28.774417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 317/661] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:28 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1321 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:29.794084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:29.794745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:29.801043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.801515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.801938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.802639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:29.803084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:29.803501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:29.863531 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:29.871662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b11f8ee2-5fe5-4e8c-8900-0df40f1fbc3e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1321 microversion: 2.1 time: 0.081384 Sep 01 16:39:29.872213 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 345/662] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:29 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1321 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:30.891809 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:30.892443 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:30.899016 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.900142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.900577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.901288 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.901742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.902164 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.932282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:30.932756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:30.933191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:30.933629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lazy-loading 'fault' on Instance uuid 6a5bd3ba-2902-4456-a6f9-0f43241577ae {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:39:30.974213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:30.982356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a84c7322-5fa3-4051-8d8c-4219a8f24f8c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 200 len: 1326 microversion: 2.1 time: 0.094299 Sep 01 16:39:30.982950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 318/663] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:30 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:32.003653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.004257 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:32.010970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.011451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.011880 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.012562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:32.013013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:32.013432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:32.027276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] HTTP exception thrown: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Request method failure captured: Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae HTTP/1.1 Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5KQCbuLENsbVDUruBkzAhO99_BQIMWASWNppFZDucDvObkmpOJx99kzNIfh7oj_vnd_tQf44BPwzNg-7NuXMbnGLuMSrUNDP_Vk_TFU-MSraHIjZAeUsl2Y_qtvro_Qsx_zd0tOzkU7YXeAgmna6PfWfqXWNe6huFEG1EbqjXo8hM Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:39:32.028878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b61e46f94b44e6d963e27ccae5dd165", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}] Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 4ecfc51400414558b8389a9c35b2fa1c Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:39:32.030529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '6a5bd3ba-2902-4456-a6f9-0f43241577ae'} Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:39:32.032214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:39:32.034510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:39:32.035949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Returning 404 to user: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:39:32.035949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3e43c9a6-2494-467f-a1f3-14e5f5e81f1e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 404 len: 111 microversion: 2.1 time: 0.030558 Sep 01 16:39:32.035949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 346/664] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:31 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:39:32.041969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d8a1c869-cce3-4db9-aaa7-2a6b914bb585 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '.version_select at 0x7f6c9cd2a9d0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:32.048155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:39:32.048311 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:39:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1433494585 (ip 10.222.0.58) !!! Sep 01 16:39:32.065531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d8a1c869-cce3-4db9-aaa7-2a6b914bb585 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433494585" status: 202 len: 0 microversion: 2.1 time: 0.029747 Sep 01 16:39:32.066121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 319/665] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Sep 1 16:39:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433494585 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:39:32.717405 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f3f366bf-24e6-4f75-86ce-3ba47d8a4a47 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: .version_select at 0x7f6c9ccff1f0>, body: {"keypair": {"name": "tempest-keypair-969037709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL41noobsMeZY+MfCQrebhxmq72mbSp+DD4J90u/MwuwEeCOEHZrp0zfJy1434FbuUI/D28BH5ZNyIkjoKaR7IqyEnJDMekisRRGHB39VwgYyEz97wF4/tpucihD2Foc9Q=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:32.735663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-f3f366bf-24e6-4f75-86ce-3ba47d8a4a47 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:32.740791 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-f3f366bf-24e6-4f75-86ce-3ba47d8a4a47 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for user 4ecfc51400414558b8389a9c35b2fa1c and project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:32.768833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f3f366bf-24e6-4f75-86ce-3ba47d8a4a47 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056995 Sep 01 16:39:32.769419 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 347/666] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:39:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:34.049194 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1194877746", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ee03cb1-3beb-431b-9524-34072887e8c9"}], "security_groups": [{"name": "tempest-securitygroup--1569804116"}], "key_name": "tempest-keypair-969037709", "user_data": "}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:34.169164 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] validate_networks() for [('4ee03cb1-3beb-431b-9524-34072887e8c9', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:39:34.662590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:39:34.663012 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:39:34.663484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:39:34.663890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:39:34.664298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:39:34.673039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.673520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.673952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.674717 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:34.675431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:34.676150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:34.696496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:39:34.700492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Getting quotas for user 4ecfc51400414558b8389a9c35b2fa1c and project 0b61e46f94b44e6d963e27ccae5dd165. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:39:34.712450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:39:34.714758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:39:34.762787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d5fd5a4b-9e7d-42d7-b172-a3f2a07c6909 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.718359 Sep 01 16:39:34.763348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 320/667] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:39:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:39:34.775203 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9b9967f8-ed67-4890-bbdb-7b6902432718 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:34.775836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9b9967f8-ed67-4890-bbdb-7b6902432718 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:34.833564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9b9967f8-ed67-4890-bbdb-7b6902432718 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:34.841565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9b9967f8-ed67-4890-bbdb-7b6902432718 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1237 microversion: 2.1 time: 0.071193 Sep 01 16:39:34.842403 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 348/668] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:34 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:35.863095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:35.863858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:35.871132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.871621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.872057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.872757 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:35.873272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:35.873699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:35.941111 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:35.948798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a1b76a4a-f903-4b2e-b1a6-260d0411d4cd tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1289 microversion: 2.1 time: 0.090229 Sep 01 16:39:35.949360 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 321/669] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:35 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:36.971821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:36.972564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:36.980296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.981054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.981486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:36.982908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:36.983523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:36.984255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.057471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:37.065386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7fcc827d-9113-4328-a9b1-37cf79ace0ce tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1295 microversion: 2.1 time: 0.100333 Sep 01 16:39:37.066285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 349/670] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:36 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:37.820324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-30e7cd06-cb36-44aa-b009-a5c93c16750a req-c106b1b8-2261-440a-b2a0-9bb5ffc602e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358173a9-6942-4c6f-b378-2106ed5d210a", "tag": "fcad7276-5883-42ed-8b3e-db2d7c4e050a"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:37.830989 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-30e7cd06-cb36-44aa-b009-a5c93c16750a req-c106b1b8-2261-440a-b2a0-9bb5ffc602e1 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:37.831604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-30e7cd06-cb36-44aa-b009-a5c93c16750a req-c106b1b8-2261-440a-b2a0-9bb5ffc602e1 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:37.832141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-30e7cd06-cb36-44aa-b009-a5c93c16750a req-c106b1b8-2261-440a-b2a0-9bb5ffc602e1 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:37.844890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-30e7cd06-cb36-44aa-b009-a5c93c16750a req-c106b1b8-2261-440a-b2a0-9bb5ffc602e1 service nova] Creating event network-changed:fcad7276-5883-42ed-8b3e-db2d7c4e050a for instance 358173a9-6942-4c6f-b378-2106ed5d210a on hv-cinder-85220 Sep 01 16:39:37.849846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-30e7cd06-cb36-44aa-b009-a5c93c16750a req-c106b1b8-2261-440a-b2a0-9bb5ffc602e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033461 Sep 01 16:39:37.850692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 322/671] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:38.088316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:38.088915 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:38.098534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.099054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.099487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.100462 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:38.101068 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:38.101752 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:38.243296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:38.251281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-816c1d4e-1acd-4caf-b983-09e4a13c8ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.167650 Sep 01 16:39:38.251916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 350/672] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:38 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:39.273054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:39.274460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:39.280843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.281502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.282004 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.282726 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:39.283175 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:39.283622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:39.417953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:39.425531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1843a237-c05d-4c1e-b8d6-d11c07c6c3b3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.157805 Sep 01 16:39:39.426097 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 323/673] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:39 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:40.446794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:40.447520 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:40.453967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.454477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.454905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.455586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:40.456028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:40.456440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:40.590850 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:40.599132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-548ad2f7-9ef5-4592-a25d-04f90262e024 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.156084 Sep 01 16:39:40.599696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 351/674] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:40 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:41.621004 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:41.621615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:41.628387 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.628871 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.629337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.630034 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:41.630530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:41.630959 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:41.760060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:41.767847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7575290d-21a5-449a-ace5-81087058b954 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.151299 Sep 01 16:39:41.768411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 324/675] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:41 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:42.789021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:42.789625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:42.796809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.797288 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.797722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.798449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:42.798895 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:42.799319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:42.935237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:42.943139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4b61aa2c-dd12-44c3-a278-beb53bd239cf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.158099 Sep 01 16:39:42.943704 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 352/676] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:42 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:43.964099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:43.964970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:43.972044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:43.972529 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:43.972967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:43.973670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:43.974129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:43.974579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.111173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:44.120317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-84706bc3-67ec-40ad-bd6d-74af7fadb1e3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.160319 Sep 01 16:39:44.120896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 325/677] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:43 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:44.919615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-327737f1-f1d3-45c0-898d-de85492d7a07 req-d37eb2ab-8048-4f3e-884f-fea220adb2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358173a9-6942-4c6f-b378-2106ed5d210a", "name": "network-vif-plugged", "status": "completed", "tag": "fcad7276-5883-42ed-8b3e-db2d7c4e050a"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:44.925347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:44.932385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-327737f1-f1d3-45c0-898d-de85492d7a07 req-d37eb2ab-8048-4f3e-884f-fea220adb2f7 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:44.933062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-327737f1-f1d3-45c0-898d-de85492d7a07 req-d37eb2ab-8048-4f3e-884f-fea220adb2f7 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:44.933490 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-327737f1-f1d3-45c0-898d-de85492d7a07 req-d37eb2ab-8048-4f3e-884f-fea220adb2f7 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:44.944982 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-327737f1-f1d3-45c0-898d-de85492d7a07 req-d37eb2ab-8048-4f3e-884f-fea220adb2f7 service nova] Creating event network-vif-plugged:fcad7276-5883-42ed-8b3e-db2d7c4e050a for instance 358173a9-6942-4c6f-b378-2106ed5d210a on hv-cinder-85220 Sep 01 16:39:44.950440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-327737f1-f1d3-45c0-898d-de85492d7a07 req-d37eb2ab-8048-4f3e-884f-fea220adb2f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034414 Sep 01 16:39:44.951255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 353/678] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:45.140940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:45.141716 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:45.145094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:45.146179 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:45.152213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:45.152818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:45.153571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.154306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:45.154768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:45.155186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:45.295361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:45.312002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bd9c734c-592a-443e-8ffb-4c6a2439853c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.174749 Sep 01 16:39:45.312702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 326/679] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:45 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:46.334738 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:46.335582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:46.342875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.343385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.343848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.344578 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:46.345056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:46.345515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:46.479618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:46.487546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-25382382-185e-4d12-822e-87c228924950 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1363 microversion: 2.1 time: 0.157805 Sep 01 16:39:46.488133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 354/680] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:46 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:47.509504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:47.510138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:47.517065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.517577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.518048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.518789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.519246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.519673 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.652913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:39:47.660815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ef64763e-71b8-4adb-a422-76ecfef41ffe tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1549 microversion: 2.1 time: 0.155921 Sep 01 16:39:47.661607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 327/681] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:39:47 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:39:47.682015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:47.682594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:47.688993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.689470 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.689899 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.690610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:47.691063 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:47.691482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:47.773892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f8b5febb-67c6-47b0-8f4c-0bee203fd659 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095262 Sep 01 16:39:47.774523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 355/682] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:39:47 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:48.728153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-e384b0d6-1af1-4ccc-8109-3eae37df3c97 req-57160383-d56e-4aff-9222-974e3bfde781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358173a9-6942-4c6f-b378-2106ed5d210a", "tag": "fcad7276-5883-42ed-8b3e-db2d7c4e050a"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:48.737878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e384b0d6-1af1-4ccc-8109-3eae37df3c97 req-57160383-d56e-4aff-9222-974e3bfde781 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:48.738390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e384b0d6-1af1-4ccc-8109-3eae37df3c97 req-57160383-d56e-4aff-9222-974e3bfde781 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:48.738836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e384b0d6-1af1-4ccc-8109-3eae37df3c97 req-57160383-d56e-4aff-9222-974e3bfde781 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:48.750495 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-e384b0d6-1af1-4ccc-8109-3eae37df3c97 req-57160383-d56e-4aff-9222-974e3bfde781 service nova] Creating event network-changed:fcad7276-5883-42ed-8b3e-db2d7c4e050a for instance 358173a9-6942-4c6f-b378-2106ed5d210a on hv-cinder-85220 Sep 01 16:39:48.756683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-e384b0d6-1af1-4ccc-8109-3eae37df3c97 req-57160383-d56e-4aff-9222-974e3bfde781 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032134 Sep 01 16:39:48.757773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 328/683] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:55.421931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:39:55.422509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:55.424431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:55.430309 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.430793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.431222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.431935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:55.432384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:55.432804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:55.437230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:55.458534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9d2b831c-9547-4b45-8e10-5548bb6ca998 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/ips" status: 200 len: 149 microversion: 2.1 time: 0.041112 Sep 01 16:39:55.459120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 356/684] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:39:55 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:39:57.863126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8281dfc1-afb0-46af-bb53-22e7b52796d7"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:39:57.865463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:39:57.868022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:57.873617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.874099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.874568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.875256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:39:57.875706 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:39:57.876126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:39:57.880658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=81 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:39:58.160862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-86ecb38b-671f-49ec-a659-2b34c4a52db0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302717 Sep 01 16:39:58.161496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 329/685] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:39:57 2022] POST /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:06.753041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8281dfc1-afb0-46af-bb53-22e7b52796d7"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:06.755469 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:06.757637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:06.763997 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.764480 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.764913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.765612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.766059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.766509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.848957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Invalid volume: volume 8281dfc1-afb0-46af-bb53-22e7b52796d7 is already attached to instances: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: POST /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments HTTP/1.1 Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 74 Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:40:06.852158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {"volumeAttachment": {"volumeId": "8281dfc1-afb0-46af-bb53-22e7b52796d7"}} Sep 01 16:40:06.853786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Invalid volume: volume 8281dfc1-afb0-46af-bb53-22e7b52796d7 is already attached to instances: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'server_id': 'a859d3d7-ed03-4ba3-a475-9752cfb9e0bd', 'body': {'volumeAttachment': {'volumeId': '8281dfc1-afb0-46af-bb53-22e7b52796d7'}}} Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8281dfc1-afb0-46af-bb53-22e7b52796d7 is already attached to instances: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:06.854597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8281dfc1-afb0-46af-bb53-22e7b52796d7 is already attached to instances: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:06.855842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8281dfc1-afb0-46af-bb53-22e7b52796d7 is already attached to instances: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 400 to user: Invalid volume: volume 8281dfc1-afb0-46af-bb53-22e7b52796d7 is already attached to instances: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cfe6cb0c-e022-4bcf-81f6-a574602a12eb tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105252 Sep 01 16:40:06.857074 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 357/686] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:40:06 2022] POST /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:40:06.919153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:06.919739 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:06.925898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.926428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.926880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:06.927557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:06.928056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:06.928478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.010358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lazy-loading 'services' on Instance uuid a859d3d7-ed03-4ba3-a475-9752cfb9e0bd {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:07.085617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1580e065-7726-4884-9e5f-1f246eb7273e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments/8281dfc1-afb0-46af-bb53-22e7b52796d7" status: 202 len: 0 microversion: 2.1 time: 0.171077 Sep 01 16:40:07.086298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 330/687] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:40:06 2022] DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments/8281dfc1-afb0-46af-bb53-22e7b52796d7 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:40:07.094796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:07.096962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:07.104182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.104661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.105094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.105813 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:07.106290 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:07.106864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:07.138042 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c1ce0e18-0304-4c7b-8f3f-771a069cfd0a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047160 Sep 01 16:40:07.138633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 358/688] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:07 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:08.152069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:08.154509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:08.161356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.161829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.162358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.163041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:08.163652 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:08.164075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:08.197112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-05af0b8d-3f9d-4f2c-8a06-c58539d80baf tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050089 Sep 01 16:40:08.197906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 331/689] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:08 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:09.209349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.212104 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.218807 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.219279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.219706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.220412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.220854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.221296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.253154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-71f4267b-dd1b-4440-a15c-0031b9b1d5e5 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047765 Sep 01 16:40:09.253701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 359/690] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:40:09 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:40:09.314872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.315342 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.322239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.322714 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.323139 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.323819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.324264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.324677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.351867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:09.427815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-983cfd82-25e8-4165-8307-2b443e8a9c9d tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 204 len: 0 microversion: 2.1 time: 0.116404 Sep 01 16:40:09.428510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 332/691] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:09 2022] DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:09.436597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:09.437201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:09.443123 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.443600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.444031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.444707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:09.445155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:09.446098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:09.575905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:09.583488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-eca4aeda-27f8-4970-afb2-a39d15690f6c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1681 microversion: 2.1 time: 0.150662 Sep 01 16:40:09.584058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 360/692] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:09 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:10.605643 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:10.606852 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:10.614001 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.614512 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.614946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.615625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:10.616070 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:10.616486 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:10.744145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:10.751988 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0cc2275c-0b2a-43eb-ae31-25446a539286 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1681 microversion: 2.1 time: 0.151272 Sep 01 16:40:10.752550 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 333/693] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:10 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:11.773205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:11.773936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:11.780694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.781231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.781686 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.782412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:11.782870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:11.783297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:11.912589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:11.921118 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-106ef16b-6474-4cce-98c2-35dc649fee19 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1681 microversion: 2.1 time: 0.152016 Sep 01 16:40:11.921698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 361/694] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:11 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:12.942274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:12.944087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:12.952310 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.952911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.953423 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.954766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.955340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.955906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:12.962359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-9c596467-1c7d-494d-81f8-b7cf09c1541e req-8ce5996b-b017-48a8-a4f7-1c804843c24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a859d3d7-ed03-4ba3-a475-9752cfb9e0bd", "name": "network-vif-deleted", "tag": "1702b6a3-03a5-4b50-ac27-255919849285"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:12.987773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9c596467-1c7d-494d-81f8-b7cf09c1541e req-8ce5996b-b017-48a8-a4f7-1c804843c24a service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:12.991385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9c596467-1c7d-494d-81f8-b7cf09c1541e req-8ce5996b-b017-48a8-a4f7-1c804843c24a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:12.991984 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9c596467-1c7d-494d-81f8-b7cf09c1541e req-8ce5996b-b017-48a8-a4f7-1c804843c24a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:13.018900 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-9c596467-1c7d-494d-81f8-b7cf09c1541e req-8ce5996b-b017-48a8-a4f7-1c804843c24a service nova] Creating event network-vif-deleted:1702b6a3-03a5-4b50-ac27-255919849285 for instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd on hv-cinder-85220 Sep 01 16:40:13.032117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-9c596467-1c7d-494d-81f8-b7cf09c1541e req-8ce5996b-b017-48a8-a4f7-1c804843c24a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073558 Sep 01 16:40:13.033035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 362/695] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:13.091006 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:13.103709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4d3737e1-5594-4fb0-a791-f89ca714a877 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 200 len: 1613 microversion: 2.1 time: 0.166329 Sep 01 16:40:13.104305 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 334/696] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:12 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 1613 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:14.125620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:14.126348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:14.132644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.133117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.133545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.134258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:14.134710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:14.135129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:14.149341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd HTTP/1.1 Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:40:14.150998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:40:14.152602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'a859d3d7-ed03-4ba3-a475-9752cfb9e0bd'} Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:14.157180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:40:14.158669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:40:14.159932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:14.159932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-44b3454d-cfd6-4039-9237-e0bc57c4cb36 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 404 len: 111 microversion: 2.1 time: 0.031466 Sep 01 16:40:14.159932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 363/697] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:14 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:14.161236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-457ef3be-5b0d-4c20-8be3-57d27b3001a7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '.version_select at 0x7f6c9cccddc0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:14.180357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-457ef3be-5b0d-4c20-8be3-57d27b3001a7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516437458" status: 202 len: 0 microversion: 2.1 time: 0.022779 Sep 01 16:40:14.181249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 335/698] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Sep 1 16:40:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1516437458 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 16:40:14.796926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c7a46a60-20e9-4c67-83e8-eb86a511d681 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: .version_select at 0x7f6c9cd04ca0>, body: {"keypair": {"name": "tempest-keypair-1462971412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/f+29DZ8F3u4z2BA+AI6jq0htRs3A+nrXJ8m+5Q46CEE6JJJN658YB7e43KyE8c5RRY4+c7Mj3/kLHpgcKVYyouBYih6SVUCiROQb0XMmVroFLHgFY3n3a4yE6AILjOA=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:14.812339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-c7a46a60-20e9-4c67-83e8-eb86a511d681 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:14.816098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-c7a46a60-20e9-4c67-83e8-eb86a511d681 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:14.838698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c7a46a60-20e9-4c67-83e8-eb86a511d681 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045734 Sep 01 16:40:14.839275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 364/699] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:40:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:16.324262 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2108578747", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56174d1-438e-442e-9134-7098a8e04072"}], "security_groups": [{"name": "tempest-securitygroup--557739305"}], "key_name": "tempest-keypair-1462971412", "user_data": "}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:16.427865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] validate_networks() for [('b56174d1-438e-442e-9134-7098a8e04072', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:16.821052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:16.821473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:16.821968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:16.822380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:16.822793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:16.831514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.831992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.832417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.833123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:16.833573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:16.833988 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:16.850247 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:16.854638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Getting quotas for user 024adeb8a8e14d678ae14174d9555152 and project 7d5bb8b858e545b2bcede8b26a2188a3. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:16.865271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:16.868136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:16.914354 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e409cf0b-c25a-4ffc-8516-f91373563dc0 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.595037 Sep 01 16:40:16.915003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 336/700] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:40:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:40:16.925711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-58c324ab-2bf3-42bc-996f-b9be7443402c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:16.926349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-58c324ab-2bf3-42bc-996f-b9be7443402c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:16.989091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-58c324ab-2bf3-42bc-996f-b9be7443402c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:16.997253 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-58c324ab-2bf3-42bc-996f-b9be7443402c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1242 microversion: 2.1 time: 0.075313 Sep 01 16:40:16.998013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 365/701] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:16 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:18.021882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:18.022522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:18.028621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.029104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.029536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.030279 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:18.030739 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:18.031163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:18.096543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:18.104312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-631d214b-4c48-409e-8f89-77ee172cfb66 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1246 microversion: 2.1 time: 0.087127 Sep 01 16:40:18.104881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 337/702] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:18 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:19.124756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:19.125375 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:19.131770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.132249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.132732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.133422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:19.133869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:19.134360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:19.196584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:19.204397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e0b56f8d-5371-46a1-9993-c894af2a2f61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1238 microversion: 2.1 time: 0.083456 Sep 01 16:40:19.204967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 366/703] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:19 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:20.225948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:20.227155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:20.233541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.234018 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.234485 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.235175 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:20.235628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:20.236048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:20.301341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:20.309061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1e3db839-782e-49fc-8fab-e9687c52f3f3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1300 microversion: 2.1 time: 0.087007 Sep 01 16:40:20.309642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 338/704] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:20 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:21.329595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:21.330225 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:21.338450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.339039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.339594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.340435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.340973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.341457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.368760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-1c93a339-1547-4e94-8d32-606253e7a675 req-0ef86ecd-75e5-453c-9385-8b99fe15fa48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94c51b3-5e48-4015-a634-e5fe1eb2ff7e", "tag": "88c81c32-f367-4507-8576-db444d596448"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:21.388781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-1c93a339-1547-4e94-8d32-606253e7a675 req-0ef86ecd-75e5-453c-9385-8b99fe15fa48 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:21.389258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-1c93a339-1547-4e94-8d32-606253e7a675 req-0ef86ecd-75e5-453c-9385-8b99fe15fa48 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:21.389677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-1c93a339-1547-4e94-8d32-606253e7a675 req-0ef86ecd-75e5-453c-9385-8b99fe15fa48 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:21.401249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-1c93a339-1547-4e94-8d32-606253e7a675 req-0ef86ecd-75e5-453c-9385-8b99fe15fa48 service nova] Creating event network-changed:88c81c32-f367-4507-8576-db444d596448 for instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e on hv-cinder-85220 Sep 01 16:40:21.406131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-1c93a339-1547-4e94-8d32-606253e7a675 req-0ef86ecd-75e5-453c-9385-8b99fe15fa48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043034 Sep 01 16:40:21.406758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 339/705] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:21.474463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:21.482965 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8016a923-e622-4a1e-8869-f92db311e047 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.157702 Sep 01 16:40:21.483546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 367/706] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:21 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:22.505137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:22.505861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:22.512068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.512545 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.512979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.513660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:22.514113 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:22.514558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:22.644642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:22.652812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7f904f20-7d40-42ca-b3ce-fbb27dafef7e tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.152337 Sep 01 16:40:22.653375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 340/707] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:22 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:23.673408 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:23.673999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:23.681126 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.681599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.682032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.682766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:23.683221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:23.683633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:23.818842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:23.826642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-94da79e4-7fbb-4a3c-8d9d-b02a24b32967 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.157059 Sep 01 16:40:23.827211 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 368/708] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:23 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:24.846920 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:24.847522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:24.854618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.855095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.855529 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.856211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:24.856663 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:24.857085 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:24.982559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:24.990659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cb663a22-3095-4a16-afcf-eca63649c326 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.147556 Sep 01 16:40:24.991232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 341/709] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:24 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:26.011004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:26.011630 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:26.018109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.018869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.019304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.019987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:26.020433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:26.020849 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:26.154959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:26.162583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-657248d7-44ca-4841-b093-98179271afe3 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.155281 Sep 01 16:40:26.163688 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 369/710] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:26 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:27.184226 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:27.184834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:27.187258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.187919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.195919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-936db0ed-73f7-4360-81eb-3aabca894710 req-83417dcd-da87-400e-8b75-5c797498f603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c51b3-5e48-4015-a634-e5fe1eb2ff7e", "name": "network-vif-plugged", "status": "completed", "tag": "88c81c32-f367-4507-8576-db444d596448"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:27.200626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:27.206020 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.206546 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.206982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.207681 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.208132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.208554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.217800 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-936db0ed-73f7-4360-81eb-3aabca894710 req-83417dcd-da87-400e-8b75-5c797498f603 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:27.218614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-936db0ed-73f7-4360-81eb-3aabca894710 req-83417dcd-da87-400e-8b75-5c797498f603 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:27.218754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-936db0ed-73f7-4360-81eb-3aabca894710 req-83417dcd-da87-400e-8b75-5c797498f603 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:27.230541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-936db0ed-73f7-4360-81eb-3aabca894710 req-83417dcd-da87-400e-8b75-5c797498f603 service nova] Creating event network-vif-plugged:88c81c32-f367-4507-8576-db444d596448 for instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e on hv-cinder-85220 Sep 01 16:40:27.237822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-936db0ed-73f7-4360-81eb-3aabca894710 req-83417dcd-da87-400e-8b75-5c797498f603 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046248 Sep 01 16:40:27.239222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 370/711] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:27.342876 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:27.351098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f8d60c34-252e-4f37-ba56-861e2d94f54c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.170232 Sep 01 16:40:27.351689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 342/712] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:27 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:27.911950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-929922903", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:27.967784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] validate_networks() for None {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:40:28.235586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:40:28.236146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:40:28.236468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:40:28.236878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:40:28.237285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:40:28.246745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.247227 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.247660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.248381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.248836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.249259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.265739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Getting quotas for project 49b52a22474544d9a239d23ed90f7a54. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:40:28.270009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Getting quotas for user 72633073b3b148a99e37c87b585fd832 and project 49b52a22474544d9a239d23ed90f7a54. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:40:28.281239 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:40:28.283611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:40:28.329258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9b653fbb-baa7-49bb-abeb-a5da130f225c tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.421498 Sep 01 16:40:28.329908 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 371/713] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:40:28.341496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-74a10d79-8702-4aaa-ab61-16e8dbceb999 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:28.342221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-74a10d79-8702-4aaa-ab61-16e8dbceb999 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.344627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:28.372812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:28.373434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:28.380059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.380546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.380986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.381750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:28.382420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:28.382853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:28.401771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-74a10d79-8702-4aaa-ab61-16e8dbceb999 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.409541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-74a10d79-8702-4aaa-ab61-16e8dbceb999 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1214 microversion: 2.1 time: 0.072109 Sep 01 16:40:28.410123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 343/714] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:28 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:28.515961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:28.525333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4bc89065-a9c3-4aca-b010-787aed9acb0f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.156427 Sep 01 16:40:28.526423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 372/715] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:28 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:29.431278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.431881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.439077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.439561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.439999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.440689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.441147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.441571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.444215 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:29.507346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.514992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6c0e587e-fc31-44a7-ba18-afcf3b834fe4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1266 microversion: 2.1 time: 0.088061 Sep 01 16:40:29.515570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 344/716] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:29.546689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:29.547291 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:29.554274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.554745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.555168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.555840 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:29.556283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:29.556699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:29.685015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:29.692508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c6848aa0-67af-454e-b5bd-f0787fd5f089 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1367 microversion: 2.1 time: 0.149710 Sep 01 16:40:29.693064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 373/717] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:29 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:30.536784 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.537398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.544440 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.544924 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.545382 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.546086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.546562 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.547307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.614436 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.623165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e7085579-fb8c-4271-a4b8-57f58183b7db tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1272 microversion: 2.1 time: 0.090929 Sep 01 16:40:30.623888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 345/718] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:30.713047 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.713683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.720415 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.720892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.721325 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.722032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.722515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.722939 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.856113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:30.863951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bdeb3738-af65-4734-a2f2-a1c160a74fa7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1557 microversion: 2.1 time: 0.154821 Sep 01 16:40:30.864453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 374/719] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:30.885072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:30.885569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:30.891466 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.891955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.892387 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.893077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:30.893791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:30.894232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:30.972198 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a23d135c-70be-4f88-a1e4-567fa392830a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091608 Sep 01 16:40:30.972800 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 346/720] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Sep 1 16:40:30 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:31.651084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:31.652741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:31.664836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.665480 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.665923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.667163 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:31.667620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:31.668240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:31.855399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:31.864013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-25f0806a-9670-4627-b4e4-f91460dd7d62 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.221703 Sep 01 16:40:31.864697 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 375/721] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:31 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:32.017320 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-6b83459b-c8e1-42b6-9358-855b9132a063 req-9518ed50-58dc-4273-a11f-7a360f5ce30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94c51b3-5e48-4015-a634-e5fe1eb2ff7e", "tag": "88c81c32-f367-4507-8576-db444d596448"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:32.032031 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-6b83459b-c8e1-42b6-9358-855b9132a063 req-9518ed50-58dc-4273-a11f-7a360f5ce30e service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.032985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-6b83459b-c8e1-42b6-9358-855b9132a063 req-9518ed50-58dc-4273-a11f-7a360f5ce30e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.033793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-6b83459b-c8e1-42b6-9358-855b9132a063 req-9518ed50-58dc-4273-a11f-7a360f5ce30e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.047597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-6b83459b-c8e1-42b6-9358-855b9132a063 req-9518ed50-58dc-4273-a11f-7a360f5ce30e service nova] Creating event network-changed:88c81c32-f367-4507-8576-db444d596448 for instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e on hv-cinder-85220 Sep 01 16:40:32.053882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-6b83459b-c8e1-42b6-9358-855b9132a063 req-9518ed50-58dc-4273-a11f-7a360f5ce30e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042734 Sep 01 16:40:32.055539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 347/722] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:32.181876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-07558418-6716-4c53-acb2-18784aaec4e7 req-a7929967-bcbf-453d-b7b8-8c4f8af4ebca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6908625-3b5a-4b28-8858-defd67ded2fa", "tag": "3218e30a-1f16-43c1-bc5a-1fcf49b18dcd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:32.212413 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-07558418-6716-4c53-acb2-18784aaec4e7 req-a7929967-bcbf-453d-b7b8-8c4f8af4ebca service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.213052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-07558418-6716-4c53-acb2-18784aaec4e7 req-a7929967-bcbf-453d-b7b8-8c4f8af4ebca service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.213587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-07558418-6716-4c53-acb2-18784aaec4e7 req-a7929967-bcbf-453d-b7b8-8c4f8af4ebca service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.235458 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-07558418-6716-4c53-acb2-18784aaec4e7 req-a7929967-bcbf-453d-b7b8-8c4f8af4ebca service nova] Creating event network-changed:3218e30a-1f16-43c1-bc5a-1fcf49b18dcd for instance b6908625-3b5a-4b28-8858-defd67ded2fa on hv-cinder-85220 Sep 01 16:40:32.243993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-07558418-6716-4c53-acb2-18784aaec4e7 req-a7929967-bcbf-453d-b7b8-8c4f8af4ebca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066225 Sep 01 16:40:32.245356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 376/723] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:32.887075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:32.887862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:32.894282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.894783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.895188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:32.895878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:32.896324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:32.896741 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:33.027445 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:33.035427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-661268ef-bf06-4454-9a21-28eb83a057d2 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.152514 Sep 01 16:40:33.036012 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 348/724] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:32 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:34.057748 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:34.058468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:34.065191 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.065679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.066114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.066847 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:34.067304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:34.067749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:34.196583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:34.204212 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-20aeacc1-e31d-446b-9bf9-529d2ddc1a4e tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.151147 Sep 01 16:40:34.204771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 377/725] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:34 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:35.066459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.067008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.073448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.073919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.074507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.075194 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.075644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.076060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.099260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-be0d948c-35a5-4a01-8052-acd744e5961e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/ips" status: 200 len: 152 microversion: 2.20 time: 0.037008 Sep 01 16:40:35.099847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 349/726] 10.222.0.58 () {60 vars in 1289 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 16:40:35.225792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:35.226434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:35.232930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.233384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.233820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.234606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:35.235032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:35.235449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:35.250588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:35.380037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:35.388727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4f4686bb-a547-4d2b-b13d-a9bfc4c84cdb tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.167245 Sep 01 16:40:35.389739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 378/727] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:35 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:36.411001 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:36.412704 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:36.421229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.421944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.422606 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.423408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:36.424129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:36.424685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:36.560867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:36.568514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-82db6993-db07-4f42-9f5d-203fd95eda96 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.161745 Sep 01 16:40:36.569081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 350/728] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:36 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:37.588865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:37.589547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:37.591884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:37.598014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.598547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.598987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.599686 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:37.600142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:37.600582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:37.727244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:37.734889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-67c4921c-e11e-4c12-88d8-92bb9e40e556 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.149841 Sep 01 16:40:37.735456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 379/729] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:37 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:38.032278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:38.032808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.040101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.040669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.041209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.041995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.042625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.043135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.069588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lazy-loading 'flavor' on Instance uuid 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:38.244706 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f459a2c2-660f-402a-806a-660331e23f3a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/action" status: 202 len: 0 microversion: 2.20 time: 0.216306 Sep 01 16:40:38.245299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 351/730] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Sep 1 16:40:38 2022] POST /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:38.253656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.254410 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.256299 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:38.263348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.263833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.264259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.265026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.265569 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.266016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.284258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:38.403164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:38.413084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:38.414654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:38.415819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f284c592-68f2-47fc-ad9e-9b75732caf69 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.166169 Sep 01 16:40:38.416386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 380/731] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:38 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:38.753351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:38.758430 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:38.759127 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:38.765811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.766322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.766755 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.767437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:38.767887 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:38.768577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:38.896226 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:38.903922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-30d9ac69-5be2-406b-826f-aab246edddda tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.151510 Sep 01 16:40:38.904501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 352/732] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:38 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:39.207918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-e4453049-9efc-4c45-8bc0-767b2e081cc8 req-a0ae86bc-d21b-45d6-bd7e-0a8918412209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6908625-3b5a-4b28-8858-defd67ded2fa", "name": "network-vif-plugged", "status": "completed", "tag": "3218e30a-1f16-43c1-bc5a-1fcf49b18dcd"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:39.218055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-e4453049-9efc-4c45-8bc0-767b2e081cc8 req-a0ae86bc-d21b-45d6-bd7e-0a8918412209 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.218565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-e4453049-9efc-4c45-8bc0-767b2e081cc8 req-a0ae86bc-d21b-45d6-bd7e-0a8918412209 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.219035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-e4453049-9efc-4c45-8bc0-767b2e081cc8 req-a0ae86bc-d21b-45d6-bd7e-0a8918412209 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.230695 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-e4453049-9efc-4c45-8bc0-767b2e081cc8 req-a0ae86bc-d21b-45d6-bd7e-0a8918412209 service nova] Creating event network-vif-plugged:3218e30a-1f16-43c1-bc5a-1fcf49b18dcd for instance b6908625-3b5a-4b28-8858-defd67ded2fa on hv-cinder-85220 Sep 01 16:40:39.235513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-e4453049-9efc-4c45-8bc0-767b2e081cc8 req-a0ae86bc-d21b-45d6-bd7e-0a8918412209 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031299 Sep 01 16:40:39.236349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 381/733] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:40:39.441411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:39.442577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:39.451055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.451878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.452563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.453640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.454390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.455082 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.587672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.595750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.597210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:39.598402 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-37a14acd-d88f-4ea5-82b6-e4467ab99ea4 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.162153 Sep 01 16:40:39.598972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 353/734] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:39 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:39.924923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:39.925623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:39.931879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.932365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.932799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:39.933485 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:39.933939 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:39.934394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.065735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.074164 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-87bb0456-8bd5-4ef7-b30e-d8c89a465ead tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.153494 Sep 01 16:40:40.074759 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 382/735] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:39 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:40.622217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:40.622790 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:40.629225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.629710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.630160 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.631508 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:40.631969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:40.632398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:40.757144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.765240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.766721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:40.767879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9ec3034c-8e35-4be6-ada8-01c00133ebca tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.149631 Sep 01 16:40:40.768717 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 354/736] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:40 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:41.095514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:41.096119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:41.103142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.103639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.104056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.104769 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.105337 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.105924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.241845 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.249648 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-933a0099-b959-44ce-b9f8-546baebb9383 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1314 microversion: 2.1 time: 0.158080 Sep 01 16:40:41.250245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 383/737] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:41 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:41.790610 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:41.791222 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:41.797749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.798258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.798697 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.799412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:41.799873 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:41.800298 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:41.925970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.935022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.936443 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:41.937660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-19d1f4b9-7806-4d31-941f-f97065a3581e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.151273 Sep 01 16:40:41.938241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 355/738] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:41 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:42.269674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.270304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.276835 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.277318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.277758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.278479 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.278933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.279356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.407750 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.415851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-98fb1e31-9403-4e7c-bf28-ac370dbfb850 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1463 microversion: 2.1 time: 0.150350 Sep 01 16:40:42.416423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 384/739] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1463 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:42.458848 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.459340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.465229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.465709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.466143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.466862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.467319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.467746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.493225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:40:42.569960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0470da21-2425-405f-982f-991b57acf1f5 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 204 len: 0 microversion: 2.1 time: 0.114410 Sep 01 16:40:42.571014 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 356/740] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:40:42 2022] DELETE /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:40:42.581269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.581833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.588619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.589103 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.589539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.590258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.590715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.591136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.717110 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:42.725289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9dc2148e-98ec-4ce5-81df-bda85017a7b4 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1469 microversion: 2.1 time: 0.148274 Sep 01 16:40:42.726244 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 385/741] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1469 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:40:42.962039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:42.962758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:42.969126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.969602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.970033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:42.970748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:42.971204 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:42.971630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.098460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:43.106609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:43.108037 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:43.109189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-da39aaff-e3fd-44a7-9955-e18045cf4803 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.152008 Sep 01 16:40:43.109755 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 357/742] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:42 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:43.746482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:43.747079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:43.753433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.753909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.754382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.755077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:43.755570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:43.755991 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:43.884920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:43.892499 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9d553c58-cb69-4159-8054-489a5e9de47f tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1469 microversion: 2.1 time: 0.149833 Sep 01 16:40:43.893320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 386/743] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:43 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:44.132724 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:44.133251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:44.139241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.139710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.140173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.140863 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.141313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.141728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.157173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:44.460002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.468038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.469484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:44.470677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c73f9075-1bee-41a1-a2e5-acea7fcf7e7d tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.341978 Sep 01 16:40:44.471247 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 358/744] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:44 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:44.913563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:44.914215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:44.920667 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.921144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.921573 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:44.922276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:44.922747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:44.923144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.104515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.112296 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c2bb3ec0-8563-4f3f-822a-e0865e8446a6 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1469 microversion: 2.1 time: 0.202526 Sep 01 16:40:45.112873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 387/745] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:44 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:45.433304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-8efbaf5a-4d0d-4d24-a0cf-ba3e4194abcd req-a0faf968-5dd2-4891-bc31-1832fe5bede0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6908625-3b5a-4b28-8858-defd67ded2fa", "name": "network-vif-deleted", "tag": "3218e30a-1f16-43c1-bc5a-1fcf49b18dcd"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:40:45.444791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-8efbaf5a-4d0d-4d24-a0cf-ba3e4194abcd req-a0faf968-5dd2-4891-bc31-1832fe5bede0 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.445271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-8efbaf5a-4d0d-4d24-a0cf-ba3e4194abcd req-a0faf968-5dd2-4891-bc31-1832fe5bede0 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.445694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-8efbaf5a-4d0d-4d24-a0cf-ba3e4194abcd req-a0faf968-5dd2-4891-bc31-1832fe5bede0 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.458052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-8efbaf5a-4d0d-4d24-a0cf-ba3e4194abcd req-a0faf968-5dd2-4891-bc31-1832fe5bede0 service nova] Creating event network-vif-deleted:3218e30a-1f16-43c1-bc5a-1fcf49b18dcd for instance b6908625-3b5a-4b28-8858-defd67ded2fa on hv-cinder-85220 Sep 01 16:40:45.464416 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-8efbaf5a-4d0d-4d24-a0cf-ba3e4194abcd req-a0faf968-5dd2-4891-bc31-1832fe5bede0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034762 Sep 01 16:40:45.465600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 359/746] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:40:45.493038 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:45.493789 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:45.500006 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.500491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.500944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.501646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:45.502097 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:45.502545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:45.638931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.648888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.650316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:45.651493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-94e80edf-eaec-4a0b-afe8-ab8611846487 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.162452 Sep 01 16:40:45.652335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 388/747] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:45 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:46.133178 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:46.133923 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:46.142295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.143152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.143584 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.144303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.144744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.145162 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.180009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.180489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.180922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.181362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lazy-loading 'fault' on Instance uuid b6908625-3b5a-4b28-8858-defd67ded2fa {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:40:46.222633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72633073b3b148a99e37c87b585fd832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b52a22474544d9a239d23ed90f7a54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.230837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7a8b7609-5cc7-471b-bce2-935684e507d9 tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 200 len: 1304 microversion: 2.1 time: 0.102357 Sep 01 16:40:46.233718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 360/748] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:46 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:40:46.673982 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:46.674605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:46.681096 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.681567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.681992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.682698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:46.683140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:46.683554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:46.811359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.819838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.821258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:46.822430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c6261d71-9a1f-47c5-8ea4-c821075930e8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.152199 Sep 01 16:40:46.822987 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 389/749] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:46 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:47.252943 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.253552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] [instance: b6908625-3b5a-4b28-8858-defd67ded2fa] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.260903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.261378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.261803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.262516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.263015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.263429 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.277497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] HTTP exception thrown: Instance b6908625-3b5a-4b28-8858-defd67ded2fa could not be found. Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Request method failure captured: Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa HTTP/1.1 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOB6BHXlPaduw9QsSyPSxd5Ftvtb24Y6tJ7Y4QNiE62iuE_JLcXWMNCORmDKl3YfwhnwdmYGv4V3UQ-X_sTVH2B2twKMGwzqzKuxV_cn_Z0b9fXFkUSDfKEkHazdvcd2X9RpzLrN3sx9TCkTcth7M7ubQEzzfO52bS-Vm1QcPEwboI8 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 49b52a22474544d9a239d23ed90f7a54 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesNegativeTest-275136320 Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:40:47.279166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49b52a22474544d9a239d23ed90f7a54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49b52a22474544d9a239d23ed90f7a54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49b52a22474544d9a239d23ed90f7a54", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49b52a22474544d9a239d23ed90f7a54"}]}] Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesNegativeTest-275136320 Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 49b52a22474544d9a239d23ed90f7a54 Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesNegativeTest-275136320 Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesNegativeTest-275136320-project Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 72633073b3b148a99e37c87b585fd832 Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesNegativeTest-275136320-project Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance b6908625-3b5a-4b28-8858-defd67ded2fa could not be found. Sep 01 16:40:47.280811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'b6908625-3b5a-4b28-8858-defd67ded2fa'} Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6908625-3b5a-4b28-8858-defd67ded2fa could not be found. Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:40:47.281753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6908625-3b5a-4b28-8858-defd67ded2fa could not be found. Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6908625-3b5a-4b28-8858-defd67ded2fa could not be found. Sep 01 16:40:47.283332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:40:47.284877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] Returning 404 to user: Instance b6908625-3b5a-4b28-8858-defd67ded2fa could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:40:47.284877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a50ac55e-c9eb-487d-bda1-18c78cbd1a6b tempest-VolumesNegativeTest-275136320 tempest-VolumesNegativeTest-275136320-project] 10.222.0.58 "GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa" status: 404 len: 111 microversion: 2.1 time: 0.031511 Sep 01 16:40:47.284877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 361/750] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/b6908625-3b5a-4b28-8858-defd67ded2fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:40:47.844979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:47.845582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:47.852157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.852631 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.853055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.853729 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:47.854380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:47.854796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:47.999155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.008821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.010355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:48.011589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bb0cc3a7-5941-44bf-8fd4-8fecba824b87 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.170512 Sep 01 16:40:48.012210 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 390/751] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:47 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:49.034406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:49.035058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:49.041974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.045414 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.046082 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.047177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:49.047677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:49.048106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:49.192011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:49.200748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:49.202187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:49.203406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-342bf993-4355-4993-8b0f-400e02c16c10 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.173057 Sep 01 16:40:49.203986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 362/752] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:49 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:50.226054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:50.226614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:50.233176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.233645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.234069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.234776 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:50.235218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:50.235638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:50.365542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.373941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.375482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:50.376680 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-881379f2-1eee-4b56-9972-c2853be65503 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.154598 Sep 01 16:40:50.377311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 391/753] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:50 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:51.401376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:51.402094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:51.408238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.408716 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.409149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.409839 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:51.410321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:51.410748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:51.581229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.590343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.591703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:51.592875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-35dec4e0-af5d-42a6-b362-77d197f6149c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.195374 Sep 01 16:40:51.593437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 363/754] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:51 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:52.617564 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:52.618172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:52.634770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.635306 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.636380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.637120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:52.637579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:52.638007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:52.778357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.786603 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.788333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:52.789632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1f188f74-dba7-42a8-8dff-f8f63661a606 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.176879 Sep 01 16:40:52.790264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 392/755] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:52 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:53.811916 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:53.812521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:53.819135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.819616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.820048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.820744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:53.821839 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:53.822297 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:53.955555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.964566 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.966009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:53.967391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-659df71a-f4b0-4017-afc5-04bf0c033ee8 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.159203 Sep 01 16:40:53.968408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 364/756] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:53 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:54.997534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:54.999008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:55.010752 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.011594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.012371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.013382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:55.014095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:55.015537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:55.246148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.255349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.257652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:55.259069 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0cc2cb25-f9a5-47e0-a608-61bfff6e8132 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.270537 Sep 01 16:40:55.260321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 393/757] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:54 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:56.287950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:56.288447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:56.295229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.295905 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.296348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.297095 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:56.297554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:56.298052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:56.478314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.487723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.489798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:56.491066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-415a7354-3430-4124-aab9-a4a673a7e252 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1746 microversion: 2.20 time: 0.210132 Sep 01 16:40:56.491889 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 365/758] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:56 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1746 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:40:57.517221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:57.518076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:57.525445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.526037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.526700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.527395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:57.528013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:57.528585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:57.718140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.726773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.728406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:57.729853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e8d3bd33-0fa0-450f-8057-fef4f1f72148 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1746 microversion: 2.20 time: 0.216262 Sep 01 16:40:57.730447 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 394/759] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:57 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1746 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:40:58.755615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:40:58.757680 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:40:58.771340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:40:58.778028 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.778896 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.779678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:58.780742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:40:58.782848 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:40:58.783593 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:40:59.061043 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.073960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.075429 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:40:59.076599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-decb28ee-121d-49f6-a48b-ddf1b4c356c0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1746 microversion: 2.20 time: 0.327340 Sep 01 16:40:59.077153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 366/760] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:40:58 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1746 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:00.104308 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:00.104920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:00.116983 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.117532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.117974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.118707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:00.119166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:00.119592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:00.301047 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:00.308030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:00.311023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:00.315178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:00.317377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9bfc15a6-5164-42b1-b30e-45be8c563a95 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1746 microversion: 2.20 time: 0.216870 Sep 01 16:41:00.333621 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 395/761] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:00 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:01.344003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:01.344670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:01.355684 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.356174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.356604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.357303 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.357751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.358392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.497940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.508021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.510149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:01.511597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-83677efb-3031-45bb-b415-f420cdc12313 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1746 microversion: 2.20 time: 0.174512 Sep 01 16:41:01.512943 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 367/762] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:01 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:01.704576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4dda9837-22c9-4a76-be0d-717383beb6af tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Action: 'create', calling method: .version_select at 0x7f6c9cc5e670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1970582924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkW/8ijxrr9yXBPC4xwCh1XmiUtj43NQQhs5Nm7Yg5C93BW3j9dlRtPzOxlvnjchAjxv2P+Fuf3w7QJtvBFn2jBK7EwPxi5ydxj2ionkqyBL/3n+40hgXomdzwOjWlljw=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:01.723504 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-4dda9837-22c9-4a76-be0d-717383beb6af tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Getting quotas for project bde90cf98c1140f298e9cc8db9c8932f. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:01.728394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-4dda9837-22c9-4a76-be0d-717383beb6af tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Getting quotas for user d0b60450d50b4fbaa9a85dd39643e403 and project bde90cf98c1140f298e9cc8db9c8932f. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:01.750912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4dda9837-22c9-4a76-be0d-717383beb6af tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.218900 Sep 01 16:41:01.751507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 396/763] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:41:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:01.796398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-e3fc5051-0033-4fec-9f13-5f2589eb01c8 req-2ce79e0a-d748-435d-8131-f627572f361e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "name": "network-vif-plugged", "status": "completed", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:01.806865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e3fc5051-0033-4fec-9f13-5f2589eb01c8 req-2ce79e0a-d748-435d-8131-f627572f361e service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:01.807607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e3fc5051-0033-4fec-9f13-5f2589eb01c8 req-2ce79e0a-d748-435d-8131-f627572f361e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:01.808548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e3fc5051-0033-4fec-9f13-5f2589eb01c8 req-2ce79e0a-d748-435d-8131-f627572f361e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:01.824617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-e3fc5051-0033-4fec-9f13-5f2589eb01c8 req-2ce79e0a-d748-435d-8131-f627572f361e service nova] Creating event network-vif-plugged:526f4514-26c0-4b58-918a-efbcf230a662 for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 on hv-cinder-85220 Sep 01 16:41:01.830373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-e3fc5051-0033-4fec-9f13-5f2589eb01c8 req-2ce79e0a-d748-435d-8131-f627572f361e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037560 Sep 01 16:41:01.831331 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 368/764] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:02.540532 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:02.541529 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:02.550124 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.551531 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.552254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.554255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:02.554885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:02.555479 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:02.731883 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:02.741665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:02.743293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:02.744423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b056aecc-e8c2-4f83-bb84-08c6b510a519 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1746 microversion: 2.20 time: 0.207978 Sep 01 16:41:02.745155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 397/765] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:02 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:03.787231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:03.787939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:03.795490 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.796458 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.797655 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.798902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:03.799761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:03.800336 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:03.969556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.978957 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.980393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:03.981659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b994f8fe-19c1-4315-8e94-be2d23f09924 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.216923 Sep 01 16:41:03.982161 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 369/766] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:03 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:05.005127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:05.006363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:05.013533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.014109 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.014576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.015282 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:05.015887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:05.016316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:05.195796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.206271 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.208713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:05.210070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-eaea3b4d-9954-4bec-9ab3-14fe10b43ccd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.209443 Sep 01 16:41:05.223374 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 398/767] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:04 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:06.237306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:06.238664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:06.246923 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.247707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.248147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.248857 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:06.249307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:06.249730 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:06.431752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.448319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.451630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:06.456066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2995c094-5ecc-4b79-a958-1073bfd6a1a9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.224841 Sep 01 16:41:06.471105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 370/768] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:06 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:07.481208 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:07.482828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:07.490125 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.490968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.491653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.492612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:07.493177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:07.493667 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:07.650628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.669345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.671800 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:07.674485 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c767c90e-bb77-400d-90d3-f3debc388af0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.197117 Sep 01 16:41:07.675872 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 399/769] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:07 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:08.713302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:08.713962 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:08.720598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.721076 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.721682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.726271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:08.726965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:08.727396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:08.884225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.892608 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.894551 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:08.895925 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-49eec6a6-708c-45fe-b9ec-d90c63e55c9a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.194599 Sep 01 16:41:08.896488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 371/770] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:08 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:09.919351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:09.920264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:09.926961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:09.929418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.930009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.930559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:09.931320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:09.931968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:09.932590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:10.091319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:10.100385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:10.101838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:10.103034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-57e084e2-5db4-458f-a4d6-6a9251f25698 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.187545 Sep 01 16:41:10.103594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 400/771] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:09 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:11.127226 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:11.127797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:11.135027 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.135503 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.136129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.137029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:11.137480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:11.138144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:11.280147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.289738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.291542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:11.292766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-51204333-4390-4d4f-8803-8dba6a9a9d8e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.169555 Sep 01 16:41:11.293567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 372/772] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:11 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:12.320193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:12.322585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:12.326605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=4 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:12.340345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.341031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.341690 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.343019 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:12.343666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:12.344968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:12.504345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.512741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.514288 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:12.515384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d7082f48-ca4d-4fef-961c-14353815dfc1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.201247 Sep 01 16:41:12.515951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 401/773] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:12 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:13.540150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:13.541357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:13.548132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.548638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.549080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.549768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:13.550421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:13.550853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:13.708035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:13.717175 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:13.718786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:13.719965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7f0cac8f-5ee9-405d-9f2c-45f6382dcd44 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.183906 Sep 01 16:41:13.735927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 373/774] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:13 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:14.743178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:14.744113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:14.751197 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.751761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.752202 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.752912 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:14.753863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:14.754311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:14.886639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:14.895695 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:14.897133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:14.898382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-727164de-301a-42af-8a87-5acf9dcd04ba tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.159121 Sep 01 16:41:14.898944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 402/775] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:14 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:15.920903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:15.921507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:15.929066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.929682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.930284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.931081 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:15.931636 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:15.932157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:15.935122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=84 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:16.081010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:16.090987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:16.093595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:16.095100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ec0e68e5-8c96-447f-82cc-52eb60b678aa tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.177713 Sep 01 16:41:16.113769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 374/776] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:15 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:17.119339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:17.119936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:17.126456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.126935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.127370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.128625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:17.129073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:17.129495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:17.264052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.272438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.273855 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:17.275017 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-40cd9d78-92bf-45b8-8fb3-4b5e638908cd tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1741 microversion: 2.20 time: 0.159547 Sep 01 16:41:17.275559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 403/777] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:17 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:18.298117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:18.298788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:18.305139 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.305621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.306088 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.306824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:18.307281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:18.307712 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:18.438245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:18.446709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:18.448138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:18.449283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-97ebe941-2c22-41f8-8b8b-179c034f0d2c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1723 microversion: 2.20 time: 0.155056 Sep 01 16:41:18.449845 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 375/778] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:18 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:19.473399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:19.474033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:19.480535 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.481013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.481445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.482132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:19.482610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:19.483034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:19.610456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:19.620281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:19.621718 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:19.622905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e59cc729-a495-4dd7-a200-54d181f5edeb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1723 microversion: 2.20 time: 0.153974 Sep 01 16:41:19.623467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 404/779] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:19 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:20.645493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:20.646049 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:20.652789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:20.653268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:20.653699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.654425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:20.654881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:20.655300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.797477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:20.806440 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:20.808438 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:20.809619 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ea8d86f6-ecc8-4c8d-860b-099d9225bcee tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1726 microversion: 2.20 time: 0.168661 Sep 01 16:41:20.810264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 376/780] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:20 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:20.834386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "733f55ed-6888-4192-8e51-b37084775ab1"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:20.836862 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:20.843274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:20.843748 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:20.844178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:20.844852 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:20.845298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:20.845711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.124811 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-468ddcfd-ca4f-4084-8d9c-739081ea4c9f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294855 Sep 01 16:41:21.125433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 405/781] 10.222.0.58 () {62 vars in 1364 bytes} [Thu Sep 1 16:41:20 2022] POST /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 16:41:21.248837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.249339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.256092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.256599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.257032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.257747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.258216 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.258665 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.374138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-524fd134-0d36-439d-9e74-034df8567ca2 req-d4b8977c-45c5-494c-8418-4d143f1068b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "name": "network-vif-unplugged", "status": "completed", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:21.386426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-524fd134-0d36-439d-9e74-034df8567ca2 req-d4b8977c-45c5-494c-8418-4d143f1068b4 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.386986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-524fd134-0d36-439d-9e74-034df8567ca2 req-d4b8977c-45c5-494c-8418-4d143f1068b4 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.387646 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-524fd134-0d36-439d-9e74-034df8567ca2 req-d4b8977c-45c5-494c-8418-4d143f1068b4 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.399465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.compute.server_external_events [req-524fd134-0d36-439d-9e74-034df8567ca2 req-d4b8977c-45c5-494c-8418-4d143f1068b4 service nova] Unable to find a host for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23. Dropping event network-vif-unplugged {{(pid=120692) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 16:41:21.400456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-524fd134-0d36-439d-9e74-034df8567ca2 req-d4b8977c-45c5-494c-8418-4d143f1068b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030572 Sep 01 16:41:21.401286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 406/782] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 16:41:21.519149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8f505bc9-c298-4e49-ad08-1363f1c6aa6c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-volume_attachments/733f55ed-6888-4192-8e51-b37084775ab1" status: 202 len: 0 microversion: 2.20 time: 0.273593 Sep 01 16:41:21.519751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 377/783] 10.222.0.58 () {60 vars in 1457 bytes} [Thu Sep 1 16:41:21 2022] DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-volume_attachments/733f55ed-6888-4192-8e51-b37084775ab1 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:21.578381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:21.579007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.584960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.585438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.585875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.586587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.587045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.587467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.617730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120692) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:41:21.682394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8d4d75bf-2bcc-4f34-a8e0-906336bafc19 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "POST /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/action" status: 202 len: 0 microversion: 2.20 time: 0.107828 Sep 01 16:41:21.682994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 407/784] 10.222.0.58 () {62 vars in 1319 bytes} [Thu Sep 1 16:41:21 2022] POST /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:41:21.691702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:21.692235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:21.698954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.699434 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.699875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.700577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:21.701033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:21.701464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:21.845879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.854333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.855997 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:21.857394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3d41591a-f3b4-468d-869d-baf9bb8afa01 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1674 microversion: 2.20 time: 0.170103 Sep 01 16:41:21.857945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 378/785] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:21 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:22.881993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:22.882711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:22.888749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:22.889227 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:22.889658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:22.890376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:22.890831 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:22.891254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:23.018640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:23.027086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:23.028629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:23.029797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-33c70605-9a99-4075-bdd2-1c3183d6c012 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.152911 Sep 01 16:41:23.030381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 408/786] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:22 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:24.054751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:24.055353 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:24.061903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.069305 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.069948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.070831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:24.071307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:24.071743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:24.225986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:24.237638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:24.239793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:24.241628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-924e73d3-84d9-4a12-a155-d06f280b5fbb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.190727 Sep 01 16:41:24.257313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 379/787] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:24 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:25.273659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:25.274674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:25.282790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.283277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.283730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.284440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:25.284898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:25.285335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:25.436089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:25.445537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:25.447026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:25.448216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-431b459a-53b8-482c-91ed-4843324f5c63 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.181735 Sep 01 16:41:25.448776 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 409/788] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:25 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:26.471403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:26.473135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:26.490548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:26.491042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:26.491482 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:26.492209 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:26.492669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:26.493111 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:26.622543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.630849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.632275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:26.633433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fcb38d39-0ad3-45c7-a329-8244b0eb33fe tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.166496 Sep 01 16:41:26.633997 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 380/789] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:26 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:27.656662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:27.657252 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:27.664654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.665135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.665563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.666284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:27.666731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:27.667146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:27.683033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:27.809318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.818642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.820202 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:27.821406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-15413299-90dd-4f6e-bd0a-e9e51692a7c9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.168720 Sep 01 16:41:27.827029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 410/790] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:27 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:28.850284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:28.851166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:28.856723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=30 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:28.858074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.858587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.859024 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:28.859728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:28.860183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:28.860607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:29.032121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:29.040212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:29.041675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:29.042893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ec44f3f3-0883-4586-8cf5-dc19fe3cf9e5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.196752 Sep 01 16:41:29.043460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 381/791] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:28 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:29.976320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1247329233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1970582924", "security_groups": [{"name": "tempest-secgroup-smoke-633776654"}], "networks": [{"uuid": "b5178fa7-223a-4af1-add0-da74a2c9ed2e"}], "block_device_mapping_v2": [{"uuid": "5d7f9894-517c-4a09-a039-08feb5acbe48", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:30.067268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.068036 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:30.076193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.076779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.077295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.078742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.079295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.080079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.114395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] validate_networks() for [('b5178fa7-223a-4af1-add0-da74a2c9ed2e', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:41:30.397277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:30.409362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:30.411981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:30.413282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b4015958-429b-4c61-8921-7e960ab2f0db tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.351179 Sep 01 16:41:30.414247 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 382/792] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:30.679045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:41:30.679502 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:41:30.680241 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:41:30.680651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:41:30.681062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:41:30.691402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.691888 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.692486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.693223 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:30.693685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:30.694277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:30.712955 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Getting quotas for project bde90cf98c1140f298e9cc8db9c8932f. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:41:30.717045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Getting quotas for user d0b60450d50b4fbaa9a85dd39643e403 and project bde90cf98c1140f298e9cc8db9c8932f. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:41:30.777638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:41:30.779817 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5d7f9894-517c-4a09-a039-08feb5acbe48',volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:41:30.933524 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e286d9ce-e764-4bf8-8391-ce20d769dfa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.960869 Sep 01 16:41:30.934862 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 411/793] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:41:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:41:30.946090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-48361f96-39dd-4132-966a-71e3f357a200 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:30.947305 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-48361f96-39dd-4132-966a-71e3f357a200 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:31.019532 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-48361f96-39dd-4132-966a-71e3f357a200 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.026963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-48361f96-39dd-4132-966a-71e3f357a200 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1089 microversion: 2.1 time: 0.084989 Sep 01 16:41:31.027916 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 383/794] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:30 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1089 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:31.439040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:31.439756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:31.447608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.448349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.448786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.449493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:31.449940 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:31.450561 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:31.587224 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.596247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.598052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:31.599523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f1eede50-fe7b-4a42-aec0-13099700a8bf tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.164433 Sep 01 16:41:31.600749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 412/795] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:31 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:32.049922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.051458 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:32.060344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.061187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.061702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.062806 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.063391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.063935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.130831 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:32.138611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-be99a1b4-8833-45a2-99d4-4c03b4cb947b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.093279 Sep 01 16:41:32.139398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 384/796] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:32.623863 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:32.624410 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:32.631625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.632098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.632524 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.633234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:32.633680 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:32.634095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:32.763945 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:32.772903 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:32.774346 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:32.775486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5820b1f8-fbb5-4a36-8e59-a620352ad89e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.155878 Sep 01 16:41:32.776038 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 413/797] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:32 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:33.160064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.160688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.167446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.167931 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.168397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.169097 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.169549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.169972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.238549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.246714 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2c214e80-33dd-40de-82a1-7991d517c4bd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.090548 Sep 01 16:41:33.247306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 385/798] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:33 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:33.799340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:33.800247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:33.806758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.807545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.808330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.809240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:33.809885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:33.810718 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:33.944661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.952990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.954464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:33.955618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a40764be-5891-445c-8c4d-3bb95f038a96 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.160910 Sep 01 16:41:33.956341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 414/799] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:33 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:34.268157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:34.268707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:34.275024 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.275502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.275933 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.276617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.277070 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.277490 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.336626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:34.344380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-855304d6-af29-4d22-88d6-0df8cd03f568 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.080985 Sep 01 16:41:34.344949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 386/800] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:34 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:34.981893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:34.982513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:34.989635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.990111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.990571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:34.991259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:34.991709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:34.992130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.121629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:35.129609 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:35.131065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:35.132207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-21f8247a-8ce4-475d-ab2d-fb1805d7828c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.154239 Sep 01 16:41:35.132762 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 415/801] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:34 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:35.366861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:35.367474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:35.373888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.374408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.374847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.375531 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:35.375987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:35.376421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:35.436399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:35.444589 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-27130511-8bb8-46f9-8fef-9c296185fd8d tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.082873 Sep 01 16:41:35.445152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 387/802] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:35 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:36.155635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:36.156237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:36.162320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.162794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.163227 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.163903 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.164351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.164765 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.291584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.300229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.301597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.302786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4679a606-931c-41ec-b414-f4c2027a5729 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.150995 Sep 01 16:41:36.303340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 416/803] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:36 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:36.465368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:36.465981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:36.473055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.473535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.473970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.475181 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:36.476032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:36.476788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:36.545595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:36.554123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-58be1cb1-392d-4bfa-bd2f-984cffcc0d66 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.092513 Sep 01 16:41:36.554668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 388/804] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:36 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:37.325591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:37.326827 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:37.334084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.334721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.335179 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.335854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.336303 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.336727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.469763 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:37.480960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:37.482453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:37.483644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ad941a8c-fca2-4617-9cf6-db3701892301 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.162177 Sep 01 16:41:37.484219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 417/805] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:37 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:37.574577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:37.575218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:37.581811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.582264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.582700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.583376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:37.583825 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:37.584242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:37.588119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:37.646822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:37.654411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-acf7a53f-1e7a-45fc-a129-fc6e6968f813 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.083760 Sep 01 16:41:37.654973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 389/806] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:37 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:38.511012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:38.511597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:38.518928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.519404 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.519833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.520512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.520961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.521379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.648757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:38.656749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:38.658277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:38.659430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a80c1100-8186-469a-b87b-54562dc11319 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.152280 Sep 01 16:41:38.659999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 418/807] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:38 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:38.674664 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:38.675272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:38.681563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.682042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.682517 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.683202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:38.683656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:38.684110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:38.743235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:38.750837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9e65400e-9265-4695-a7d0-23baaa8ffa2b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.079945 Sep 01 16:41:38.751406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 390/808] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:38 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:39.682012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:39.682717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:39.689178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.689707 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.690137 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.690855 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.691308 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.691732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.772376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:39.772986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:39.779717 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.780206 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.780639 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.781332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:39.781786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:39.782231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:39.817967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:39.826814 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:39.828253 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:39.829412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f76e5b10-266a-415a-be85-4c8857ceb3ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.151426 Sep 01 16:41:39.829976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 419/809] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:39 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:39.848755 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:39.856420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3fbf963f-6d1f-47c2-b852-d157a95e3123 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.088900 Sep 01 16:41:39.856985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 391/810] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:39 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:40.852851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:40.853438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:40.855732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.856634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.857226 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:40.863551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.864029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.864458 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.865138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.865585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.866000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.888410 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:40.890656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:40.898008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.898573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.899376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.900635 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:40.901489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:40.902238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:40.981299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:40.989294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8880e100-a70f-457c-a20c-4907c26a3fcd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.106369 Sep 01 16:41:40.989913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 392/811] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:40 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:41.016215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.025011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.026482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:41.027629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-167a83a0-0354-4092-876b-04921f990a0e tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.178709 Sep 01 16:41:41.028184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 420/812] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:40 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:42.012476 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:42.013089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:42.014944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:42.021548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.022039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.022494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.023187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.023649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.024225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.050127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:42.050753 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:42.057175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.057648 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.058072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.058783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:42.059229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:42.062052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:42.085591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:42.093456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f836a262-68f3-4822-b611-12a56e090c38 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1139 microversion: 2.1 time: 0.086169 Sep 01 16:41:42.094077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 393/813] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:42 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:42.426171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:42.434171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:42.435614 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:42.436895 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e0a1d52f-424a-4a3a-b387-f10a5fb5e8f2 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.390557 Sep 01 16:41:42.437448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 421/814] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:42 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:41:43.114301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:43.114926 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:43.121368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.121869 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.122334 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.123080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.123535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.123960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.186718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.194364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b5119836-6dde-48dd-af8d-dc235c03e622 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1187 microversion: 2.1 time: 0.084626 Sep 01 16:41:43.194940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 394/815] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:43 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:43.460094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:43.460698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:43.467161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.467636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.468062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.468748 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:43.469194 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:43.469610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:43.604773 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.613305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.614989 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:43.616523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6000ffc6-09aa-4cb8-b9b2-bb6e134801e9 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.160636 Sep 01 16:41:43.617159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 422/816] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:43 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:44.215493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:44.216097 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:44.222927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.223472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.223907 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.224629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.225086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.225514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.376062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.386231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6342dc3a-5551-4c88-949a-a8edb8711904 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1272 microversion: 2.1 time: 0.174490 Sep 01 16:41:44.386825 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 395/817] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:44 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:44.640263 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:44.641132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:44.648546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.649116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.649618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.650421 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:44.650990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:44.651478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:44.786848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.794944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.796377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:44.797533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5f0dacb3-8fe2-409b-b16d-06287dd07e5f tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.161610 Sep 01 16:41:44.798094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 423/818] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:44 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:45.256732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-3b5b839c-120d-416f-92ad-0b7e79b7be78 req-5f769a85-3cd1-452f-9bfe-1fd1845d5b8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:45.267253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-3b5b839c-120d-416f-92ad-0b7e79b7be78 req-5f769a85-3cd1-452f-9bfe-1fd1845d5b8f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.267986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-3b5b839c-120d-416f-92ad-0b7e79b7be78 req-5f769a85-3cd1-452f-9bfe-1fd1845d5b8f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.268428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-3b5b839c-120d-416f-92ad-0b7e79b7be78 req-5f769a85-3cd1-452f-9bfe-1fd1845d5b8f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.280536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-3b5b839c-120d-416f-92ad-0b7e79b7be78 req-5f769a85-3cd1-452f-9bfe-1fd1845d5b8f service nova] Creating event network-changed:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:41:45.285302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-3b5b839c-120d-416f-92ad-0b7e79b7be78 req-5f769a85-3cd1-452f-9bfe-1fd1845d5b8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032977 Sep 01 16:41:45.285901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 396/819] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:45.408444 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.409293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:45.416945 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.417569 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.418113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.418941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.419503 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.420031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.561385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:45.569596 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-32012415-ada9-4956-96fa-2e714d97efa5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.164934 Sep 01 16:41:45.570173 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 424/820] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:45 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:45.823882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:45.824505 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:45.830715 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.831196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.831633 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.832352 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:45.832834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:45.833236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:45.959977 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:45.968137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:45.969570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:45.970757 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-14ef398f-46d9-44ad-98ad-48ac88ca2b99 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.152043 Sep 01 16:41:45.971335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 397/821] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:45 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:46.591466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:46.592007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:46.598489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:46.598960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:46.599390 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:46.600070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:46.600523 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:46.600941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:46.732998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:46.741168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2ac8a201-f61f-4f4e-a368-362d98034492 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.153640 Sep 01 16:41:46.741726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 425/822] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:46 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:46.993798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:46.994413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:47.000779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.001257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.001692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.002411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.002870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.003302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.134941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.143441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.145396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.146606 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c0868faf-1556-452f-a0e6-297ab0596841 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.156626 Sep 01 16:41:47.147177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 398/823] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:46 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:47.421698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:47.422518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:47.428460 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.428940 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.429380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.430070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.430552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.430974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.454689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6094c321-cd6e-431f-9658-522f4fe0a286 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/ips" status: 200 len: 145 microversion: 2.1 time: 0.036771 Sep 01 16:41:47.455293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 426/824] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:41:47 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:47.762017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:47.762878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:47.769223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.769710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.770926 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.771894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.772401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.773038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.909932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:47.917894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1c2cb6e8-f405-45db-80d1-ce500047882f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.159986 Sep 01 16:41:47.918809 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 399/825] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:47 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:47.925975 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-c9ec2148-bbb6-470c-b1ad-4b5175f7ffb1 req-df30b07c-a620-4fe3-8aa8-30738bc9a015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "name": "network-vif-plugged", "status": "completed", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:47.937119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c9ec2148-bbb6-470c-b1ad-4b5175f7ffb1 req-df30b07c-a620-4fe3-8aa8-30738bc9a015 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:47.937605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c9ec2148-bbb6-470c-b1ad-4b5175f7ffb1 req-df30b07c-a620-4fe3-8aa8-30738bc9a015 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:47.938040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-c9ec2148-bbb6-470c-b1ad-4b5175f7ffb1 req-df30b07c-a620-4fe3-8aa8-30738bc9a015 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:47.950146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-c9ec2148-bbb6-470c-b1ad-4b5175f7ffb1 req-df30b07c-a620-4fe3-8aa8-30738bc9a015 service nova] Creating event network-vif-plugged:526f4514-26c0-4b58-918a-efbcf230a662 for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 on hv-cinder-85220 Sep 01 16:41:47.955338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-c9ec2148-bbb6-470c-b1ad-4b5175f7ffb1 req-df30b07c-a620-4fe3-8aa8-30738bc9a015 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037036 Sep 01 16:41:47.955940 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 427/826] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:41:48.170112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:48.170879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:48.177910 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.178419 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.178858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.179550 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.180011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.180433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.309785 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.317950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.319429 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:48.320577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-36c1d01c-48ea-463d-ab3c-7efdb1268855 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.155158 Sep 01 16:41:48.321142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 400/827] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:48 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:48.787071 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "192bc907-3cf3-42e3-9699-6d3d8f08fea1"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:48.789611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:48.795728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.796206 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.796641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.797322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.797774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.798216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.867059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:48.938392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:48.939008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:48.945549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.946030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.946498 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:48.947218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:48.947683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:48.948109 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.078902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.087208 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-714ea89a-02c9-4410-aeba-f1d668902064 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.152829 Sep 01 16:41:49.087776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 401/828] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:48 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:41:49.342441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:49.343080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:49.349249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.349732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.350167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.350879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:49.351336 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:49.351761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:49.482823 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.491376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.492817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:49.494768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3efab290-37bb-4739-b606-151ed6ccb694 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.156169 Sep 01 16:41:49.495341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 402/829] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:49 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:41:49.646256 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2fbaab9e-576c-423e-b7e2-718b47cc34f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864049 Sep 01 16:41:49.647030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 428/830] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:41:48 2022] POST /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments => generated 194 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:50.112622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:50.113237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:50.120236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.120722 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.121156 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.121868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.122332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.122756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.255629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:50.264502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-641278d4-321c-481d-bdc5-77fd7cec0705 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.155681 Sep 01 16:41:50.265086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 403/831] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:50 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:50.519530 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:50.520216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:50.528000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.528563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.528985 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.529668 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:50.530119 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:50.530695 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:50.673552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:50.681804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:50.683269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:50.684419 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ab794527-bf61-41a3-9778-27e0bbf91b62 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1732 microversion: 2.20 time: 0.169353 Sep 01 16:41:50.684975 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 429/832] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:50 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:51.285979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:51.286614 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:51.293167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.293640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.294073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.294780 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.295235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.295656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.431431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.439153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0c494e78-27a0-434a-a9c2-85a00796ed3f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.157036 Sep 01 16:41:51.439723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 404/833] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:51 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:51.707086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:51.707697 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:51.714453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.714937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.715374 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.716059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:51.716514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:51.716935 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:51.844050 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.852138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.853577 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:51.854776 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-374b8ca2-1518-4055-99e4-7276cd07bbde tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1719 microversion: 2.20 time: 0.151606 Sep 01 16:41:51.855332 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 430/834] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:41:51 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:41:52.460574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:52.461185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:52.467738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.468224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.468662 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.469350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:52.469813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:52.470272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:52.602055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:52.609686 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4f26c5d3-3844-44df-8ebe-c0ee43a11b50 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.153532 Sep 01 16:41:52.610272 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 405/835] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:52 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:53.632399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:53.633013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:53.639567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.640052 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.640503 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.641178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:53.641655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:53.642064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:53.772505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:53.780411 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-06a0f493-cbc0-4596-af76-cb3a210ded1c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.152292 Sep 01 16:41:53.780999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 431/836] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:53 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:54.799899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:54.800544 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:54.806960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.807428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.807854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.808528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:54.808974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:54.809390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:54.828238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:54.944468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:54.952604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-538cd0c5-c63e-4b82-b8df-d91f414fe833 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.156492 Sep 01 16:41:54.953185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 406/837] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:54 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:55.974428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:55.975036 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:55.982309 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:55.982941 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:55.983099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-e2aab803-5500-46ae-8830-c35477f749d1 req-a1429721-015b-416c-b021-393f1675aa9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "name": "network-vif-plugged", "status": "completed", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:41:55.983644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:55.984047 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:55.984497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:55.984931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:55.993018 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e2aab803-5500-46ae-8830-c35477f749d1 req-a1429721-015b-416c-b021-393f1675aa9a service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:55.993488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e2aab803-5500-46ae-8830-c35477f749d1 req-a1429721-015b-416c-b021-393f1675aa9a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:55.993909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e2aab803-5500-46ae-8830-c35477f749d1 req-a1429721-015b-416c-b021-393f1675aa9a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:56.005349 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-e2aab803-5500-46ae-8830-c35477f749d1 req-a1429721-015b-416c-b021-393f1675aa9a service nova] Creating event network-vif-plugged:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:41:56.011465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-e2aab803-5500-46ae-8830-c35477f749d1 req-a1429721-015b-416c-b021-393f1675aa9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031697 Sep 01 16:41:56.012539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 407/838] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:56.147087 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:56.154923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-52c87b61-3f76-46c6-ba73-0a68f3b165f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.184469 Sep 01 16:41:56.155491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 432/839] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:55 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:57.176393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:57.177860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:57.185177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:57.186318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:57.186797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:57.187524 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:57.188160 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:57.188721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:57.390956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:57.400353 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c64d54fd-1200-455e-aec2-c9ff2378828a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.228817 Sep 01 16:41:57.401042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 408/840] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:57 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:58.233804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:58.236145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.243364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.243850 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.244286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.245020 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.245478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.245922 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.275495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-24c50978-c864-4d47-bcb2-282c132633f7 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 Sep 01 16:41:58.276054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 433/841] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:41:58 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:58.286463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:58.287039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.293911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.294431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.294861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.295534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.295981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.296423 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.324504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-cd088b6c-b8e6-422e-b294-2cb1557e95a3 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/192bc907-3cf3-42e3-9699-6d3d8f08fea1" status: 200 len: 194 microversion: 2.1 time: 0.042021 Sep 01 16:41:58.325072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 409/842] 10.222.0.58 () {58 vars in 1413 bytes} [Thu Sep 1 16:41:58 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/192bc907-3cf3-42e3-9699-6d3d8f08fea1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:41:58.420801 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:58.421400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:58.427234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.427697 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.428157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.428833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:58.429272 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:58.429684 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:58.567709 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:58.576467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a36fb03f-9b78-4e55-b1d4-f7c40e81993a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.159483 Sep 01 16:41:58.577093 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 434/843] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:58 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:41:59.598271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:41:59.598911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:41:59.601347 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=60 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:41:59.606814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.607325 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.607762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.608459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:41:59.608920 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:41:59.609475 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:41:59.747946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:41:59.755749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-10f0aa93-065a-4989-b591-9f0e36bdbb65 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1260 microversion: 2.1 time: 0.161464 Sep 01 16:41:59.757185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 410/844] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:41:59 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:00.714884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f733dda-b491-402e-bad2-dc7979cf45af"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:00.717281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:00.723756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.724232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.724663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.725351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.726445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.726873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.777580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:00.778274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:00.784645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.785122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.785564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:00.786238 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:00.786698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:00.787122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.065987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.075185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3bd2f34c-cd51-43cb-92e2-e2044ced86a6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1444 microversion: 2.1 time: 0.301449 Sep 01 16:42:01.075750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 411/845] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:00 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1444 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:01.096399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:01.097004 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:01.104073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:01.104833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:01.105319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.106098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:01.106596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:01.106998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:01.247217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:01.250480 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-25e4da88-e28c-4e27-8d81-29a4f2fca3ff tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "POST /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539800 Sep 01 16:42:01.251097 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 435/846] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:00 2022] POST /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:01.255706 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c6c2b516-2a11-4099-8c85-6cc1642b9fce tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1444 microversion: 2.1 time: 0.163250 Sep 01 16:42:01.256378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 412/847] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:01 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1444 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:02.880186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-50de3189-413a-47a6-b4e9-9ee9a4076dc9 req-efd26780-262c-4047-b24c-529120fc441d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:02.891252 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-50de3189-413a-47a6-b4e9-9ee9a4076dc9 req-efd26780-262c-4047-b24c-529120fc441d service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:02.891729 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-50de3189-413a-47a6-b4e9-9ee9a4076dc9 req-efd26780-262c-4047-b24c-529120fc441d service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:02.892154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-50de3189-413a-47a6-b4e9-9ee9a4076dc9 req-efd26780-262c-4047-b24c-529120fc441d service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:02.903846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-50de3189-413a-47a6-b4e9-9ee9a4076dc9 req-efd26780-262c-4047-b24c-529120fc441d service nova] Creating event network-changed:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:42:02.908885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-50de3189-413a-47a6-b4e9-9ee9a4076dc9 req-efd26780-262c-4047-b24c-529120fc441d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032770 Sep 01 16:42:02.910288 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 436/848] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:09.826876 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:09.829019 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:09.835742 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.836221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.836657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.837346 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:09.837805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:09.838257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:09.873816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-aec3c6d0-0e02-422e-ab6d-edad6439044e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.050944 Sep 01 16:42:09.874397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 413/849] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:09 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:10.022758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:10.023319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.030608 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.031082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.031513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.032197 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.032647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.033065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.061791 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-355ca27c-bea3-4ae2-81b1-8f704f83ab05 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/192bc907-3cf3-42e3-9699-6d3d8f08fea1" status: 200 len: 194 microversion: 2.1 time: 0.043623 Sep 01 16:42:10.062599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 437/850] 10.222.0.58 () {58 vars in 1413 bytes} [Thu Sep 1 16:42:10 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/192bc907-3cf3-42e3-9699-6d3d8f08fea1 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:10.073142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:10.073637 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:10.079557 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.080042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.080480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.081167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:10.081623 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:10.082044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:10.172343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lazy-loading 'services' on Instance uuid 358173a9-6942-4c6f-b378-2106ed5d210a {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:10.242638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8681198f-1974-4cb3-b9ee-ffb6979d2be9 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/192bc907-3cf3-42e3-9699-6d3d8f08fea1" status: 202 len: 0 microversion: 2.1 time: 0.173778 Sep 01 16:42:10.243304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 414/851] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:10 2022] DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/192bc907-3cf3-42e3-9699-6d3d8f08fea1 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:12.598055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.598606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.601258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=36 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:12.607667 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.608149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.608585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.609270 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.609726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.610155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.639726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-66b294f2-de74-47d8-83fa-40f7253c113e tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/9f733dda-b491-402e-bad2-dc7979cf45af" status: 200 len: 194 microversion: 2.1 time: 0.045530 Sep 01 16:42:12.640246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 438/852] 10.222.0.58 () {58 vars in 1413 bytes} [Thu Sep 1 16:42:12 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/9f733dda-b491-402e-bad2-dc7979cf45af => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:12.652662 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:12.653251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:12.659467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.659950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.660386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.661068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:12.661525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:12.661950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:12.741470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lazy-loading 'services' on Instance uuid 358173a9-6942-4c6f-b378-2106ed5d210a {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:12.811568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5ee92bfc-73b2-4085-8ac8-4262b38ed929 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/9f733dda-b491-402e-bad2-dc7979cf45af" status: 202 len: 0 microversion: 2.1 time: 0.164332 Sep 01 16:42:12.812144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 415/853] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:12 2022] DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments/9f733dda-b491-402e-bad2-dc7979cf45af => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:15.036633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.038903 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.048359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.048359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.048359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.048359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.048865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.048974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.079589 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-300bbcd5-11c7-4a87-991b-7121ffe2bb7c tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046797 Sep 01 16:42:15.080162 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 439/854] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:42:15.194979 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.197906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.204761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.205316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.205814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.206615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.207068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.207491 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.238374 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-05d84dc9-8ecf-4b5c-a228-e7ae2ae4a79d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047840 Sep 01 16:42:15.238918 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 416/855] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:42:15.299221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.299719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.305592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.306075 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.306543 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.307231 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.307687 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.308114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.333032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:42:15.409020 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-86be7693-374a-4ecc-94d3-45c99779163f tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 204 len: 0 microversion: 2.1 time: 0.113410 Sep 01 16:42:15.409615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 440/856] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:15 2022] DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:42:15.419898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:15.420496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:15.426380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.426836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.427293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.427968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:15.428417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:15.428834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:15.556075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:15.564294 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0c2076d1-8a06-4d3f-9a75-2c193437d1a6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1673 microversion: 2.1 time: 0.149276 Sep 01 16:42:15.564861 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 417/857] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:15 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:16.586809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:16.587429 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:16.593807 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.594444 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.594878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.595558 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:16.596010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:16.596429 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:16.725418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:16.727734 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:16.735464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-41f1585d-20b0-4cc9-bbe6-1d3062a8d73d tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1673 microversion: 2.1 time: 0.152964 Sep 01 16:42:16.736031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 441/858] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:16 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:17.757174 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:17.757766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:17.765139 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:17.765651 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:17.766086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:17.766880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:17.767337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:17.767783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:17.897003 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:17.905586 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ec1e811c-b83a-4ea3-b5f2-4ebf91503d4b tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1673 microversion: 2.1 time: 0.152252 Sep 01 16:42:17.906163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 418/859] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:17 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:18.927092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:18.927763 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:18.935907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.936431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.936926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:18.937657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:18.938135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:18.938643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.073525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:19.081507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5efcb925-13e6-453f-9eaa-80315b50c997 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1673 microversion: 2.1 time: 0.158474 Sep 01 16:42:19.082086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 442/860] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:18 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:19.810960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-4545f429-75f9-4c26-aab5-697dc874f0d6 req-09ed599a-c22a-4357-ba44-4750f5e3c785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358173a9-6942-4c6f-b378-2106ed5d210a", "name": "network-vif-deleted", "tag": "fcad7276-5883-42ed-8b3e-db2d7c4e050a"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:19.821232 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-4545f429-75f9-4c26-aab5-697dc874f0d6 req-09ed599a-c22a-4357-ba44-4750f5e3c785 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:19.821718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-4545f429-75f9-4c26-aab5-697dc874f0d6 req-09ed599a-c22a-4357-ba44-4750f5e3c785 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:19.822376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-4545f429-75f9-4c26-aab5-697dc874f0d6 req-09ed599a-c22a-4357-ba44-4750f5e3c785 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:19.835262 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-4545f429-75f9-4c26-aab5-697dc874f0d6 req-09ed599a-c22a-4357-ba44-4750f5e3c785 service nova] Creating event network-vif-deleted:fcad7276-5883-42ed-8b3e-db2d7c4e050a for instance 358173a9-6942-4c6f-b378-2106ed5d210a on hv-cinder-85220 Sep 01 16:42:19.844071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-4545f429-75f9-4c26-aab5-697dc874f0d6 req-09ed599a-c22a-4357-ba44-4750f5e3c785 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037380 Sep 01 16:42:19.844736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 419/861] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:20.105618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:20.106482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:20.115070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.115676 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.116193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.117014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.117548 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.118248 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.154095 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:20.154591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:20.155028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:20.155492 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lazy-loading 'fault' on Instance uuid 358173a9-6942-4c6f-b378-2106ed5d210a {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:20.200622 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ecfc51400414558b8389a9c35b2fa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b61e46f94b44e6d963e27ccae5dd165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:20.209180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-92cf2af1-cc50-4bf3-a1b8-eecce7ac4b59 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 200 len: 1327 microversion: 2.1 time: 0.109080 Sep 01 16:42:20.210024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 443/862] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:20 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:42:21.232400 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:21.233220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:21.239415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.239901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.240337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.241032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:21.241490 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:21.241915 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:21.255963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] HTTP exception thrown: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Request method failure captured: Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a HTTP/1.1 Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5KQCbuLENsbVDUruBkzAhO99_BQIMWASWNppFZDucDvObkmpOJx99kzNIfh7oj_vnd_tQf44BPwzNg-7NuXMbnGLuMSrUNDP_Vk_TFU-MSraHIjZAeUsl2Y_qtvro_Qsx_zd0tOzkU7YXeAgmna6PfWfqXWNe6huFEG1EbqjXo8hM Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:21.257559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b61e46f94b44e6d963e27ccae5dd165", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}] Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 4ecfc51400414558b8389a9c35b2fa1c Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:21.259326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '358173a9-6942-4c6f-b378-2106ed5d210a'} Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:21.260509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:21.262166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:21.263709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Returning 404 to user: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:21.263709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c6842cc8-0421-43e8-a198-aa2a3ad92c69 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 404 len: 111 microversion: 2.1 time: 0.031795 Sep 01 16:42:21.263709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 420/863] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:21 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:21.268028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d233eaf3-cb2c-490e-b4d0-a8d2999d1d21 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '.version_select at 0x7f6c9cc5e310>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:21.287602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d233eaf3-cb2c-490e-b4d0-a8d2999d1d21 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-969037709" status: 202 len: 0 microversion: 2.1 time: 0.023288 Sep 01 16:42:21.288262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 444/864] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Sep 1 16:42:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-969037709 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:24.183489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:24.184072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:24.190393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.190862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.191288 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.191964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.192444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.192864 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.206446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] HTTP exception thrown: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Request method failure captured: Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a HTTP/1.1 Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5KQCbuLENsbVDUruBkzAhO99_BQIMWASWNppFZDucDvObkmpOJx99kzNIfh7oj_vnd_tQf44BPwzNg-7NuXMbnGLuMSrUNDP_Vk_TFU-MSraHIjZAeUsl2Y_qtvro_Qsx_zd0tOzkU7YXeAgmna6PfWfqXWNe6huFEG1EbqjXo8hM Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:24.207929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b61e46f94b44e6d963e27ccae5dd165", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}] Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 4ecfc51400414558b8389a9c35b2fa1c Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.209628 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '358173a9-6942-4c6f-b378-2106ed5d210a'} Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:24.210779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.212261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.214750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Returning 404 to user: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:24.214750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a440557e-db0c-4482-b075-efa3183ff432 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 404 len: 111 microversion: 2.1 time: 0.029634 Sep 01 16:42:24.214750 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 421/865] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:24 2022] DELETE /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:24.218078 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:24.218719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 358173a9-6942-4c6f-b378-2106ed5d210a] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:24.225660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.226148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.226710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.227413 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:24.227894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:24.228319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:24.241516 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] HTTP exception thrown: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Request method failure captured: Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a HTTP/1.1 Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5KQCbuLENsbVDUruBkzAhO99_BQIMWASWNppFZDucDvObkmpOJx99kzNIfh7oj_vnd_tQf44BPwzNg-7NuXMbnGLuMSrUNDP_Vk_TFU-MSraHIjZAeUsl2Y_qtvro_Qsx_zd0tOzkU7YXeAgmna6PfWfqXWNe6huFEG1EbqjXo8hM Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:24.243268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b61e46f94b44e6d963e27ccae5dd165", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}] Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 4ecfc51400414558b8389a9c35b2fa1c Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.244727 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '358173a9-6942-4c6f-b378-2106ed5d210a'} Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:24.245746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. Sep 01 16:42:24.247355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:24.248714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Returning 404 to user: Instance 358173a9-6942-4c6f-b378-2106ed5d210a could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:24.248714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-825267a7-449e-4a46-8f39-48917d3a0c15 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a" status: 404 len: 111 microversion: 2.1 time: 0.032318 Sep 01 16:42:24.248714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 445/866] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:24 2022] GET /compute/v2.1/servers/358173a9-6942-4c6f-b378-2106ed5d210a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:25.403237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:25.403724 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:25.410043 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.410560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.410994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.411680 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.412135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.412558 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.415205 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:25.428361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] HTTP exception thrown: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Request method failure captured: Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae HTTP/1.1 Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5KQCbuLENsbVDUruBkzAhO99_BQIMWASWNppFZDucDvObkmpOJx99kzNIfh7oj_vnd_tQf44BPwzNg-7NuXMbnGLuMSrUNDP_Vk_TFU-MSraHIjZAeUsl2Y_qtvro_Qsx_zd0tOzkU7YXeAgmna6PfWfqXWNe6huFEG1EbqjXo8hM Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:25.429872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b61e46f94b44e6d963e27ccae5dd165", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}] Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 4ecfc51400414558b8389a9c35b2fa1c Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.431527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '6a5bd3ba-2902-4456-a6f9-0f43241577ae'} Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:25.432575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.434682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.436135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Returning 404 to user: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:25.436135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9d16588e-e8ce-4b5f-9cc7-cfea90978caf tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 404 len: 111 microversion: 2.1 time: 0.032132 Sep 01 16:42:25.436135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 422/867] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:25 2022] DELETE /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:25.440187 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:25.440796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] [instance: 6a5bd3ba-2902-4456-a6f9-0f43241577ae] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:25.447444 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.447926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.449004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.449705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:25.450161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:25.450647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:25.463839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] HTTP exception thrown: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Request method failure captured: Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae HTTP/1.1 Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5KQCbuLENsbVDUruBkzAhO99_BQIMWASWNppFZDucDvObkmpOJx99kzNIfh7oj_vnd_tQf44BPwzNg-7NuXMbnGLuMSrUNDP_Vk_TFU-MSraHIjZAeUsl2Y_qtvro_Qsx_zd0tOzkU7YXeAgmna6PfWfqXWNe6huFEG1EbqjXo8hM Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:25.465377 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b61e46f94b44e6d963e27ccae5dd165", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b61e46f94b44e6d963e27ccae5dd165"}]}] Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 0b61e46f94b44e6d963e27ccae5dd165 Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1022951726 Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 4ecfc51400414558b8389a9c35b2fa1c Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeTestJSON-1022951726-project Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.466996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '6a5bd3ba-2902-4456-a6f9-0f43241577ae'} Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:25.467892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. Sep 01 16:42:25.469376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:25.470710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] Returning 404 to user: Instance 6a5bd3ba-2902-4456-a6f9-0f43241577ae could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:25.470710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ff23bb41-b0b7-4b64-b0b7-cce3bb6fffb6 tempest-AttachVolumeTestJSON-1022951726 tempest-AttachVolumeTestJSON-1022951726-project] 10.222.0.58 "GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae" status: 404 len: 111 microversion: 2.1 time: 0.030398 Sep 01 16:42:25.470710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 446/868] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:25 2022] GET /compute/v2.1/servers/6a5bd3ba-2902-4456-a6f9-0f43241577ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:28.369862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:28.370431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:28.377449 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.378395 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.379368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.380669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:28.381999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:28.382787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:28.410793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8ce70965-3489-4477-bc67-2e6a702804d1 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/ips" status: 200 len: 149 microversion: 2.1 time: 0.203834 Sep 01 16:42:28.411844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 423/869] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:42:28 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/ips => generated 149 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:30.075421 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f2754a8c-8b24-4af1-ac00-e08162779234 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Action: 'create', calling method: .version_select at 0x7f6c9cec8280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-230795377", "metadata": {"Type": "work"}}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f2754a8c-8b24-4af1-ac00-e08162779234 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Request method failure captured: Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 121 Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOD15ojmttA3DeFR-s_8AQTuZN9Gg5x5efS_wA_c9yoISwRQJMasxEwE63_ZoWr4x5gJocQfXOgyOatUNJYvxm7rar5MxHbkGs6oyNINaSHZljTRC64FymgJnD8Rh0OTQsqM-LYxR1beT1J3XTdMeUI1KRnFjha5TosPXIHK9IK5P3M Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:30.087641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c38be99d56404657938612fa8c06999f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c38be99d56404657938612fa8c06999f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}] Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 6c5ce5557d60473f9b85373892ad5c8f Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-230795377", "metadata": {"Type": "work"}}} Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:42:30.089276 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-230795377', 'metadata': {'Type': 'work'}}}} Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:30.090356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:42:30.092319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:42:30.094328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 16:42:30.094328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.094328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f2754a8c-8b24-4af1-ac00-e08162779234 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:30.094328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f2754a8c-8b24-4af1-ac00-e08162779234 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.126751 Sep 01 16:42:30.094328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 447/870] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Sep 1 16:42:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:42:30.098574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9ae49f59-4258-4cec-afc6-60c6693ab09c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Action: 'create', calling method: .version_select at 0x7f6c9cd9eca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1343284743", "metadata": {"Type": "work"}}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9ae49f59-4258-4cec-afc6-60c6693ab09c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Request method failure captured: Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 120 Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOD15ojmttA3DeFR-s_8AQTuZN9Gg5x5efS_wA_c9yoISwRQJMasxEwE63_ZoWr4x5gJocQfXOgyOatUNJYvxm7rar5MxHbkGs6oyNINaSHZljTRC64FymgJnD8Rh0OTQsqM-LYxR1beT1J3XTdMeUI1KRnFjha5TosPXIHK9IK5P3M Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:30.103166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c38be99d56404657938612fa8c06999f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c38be99d56404657938612fa8c06999f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}] Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 6c5ce5557d60473f9b85373892ad5c8f Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1343284743", "metadata": {"Type": "work"}}} Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: Sep 01 16:42:30.104764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1343284743', 'metadata': {'Type': 'work'}}}} Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi '0' Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:30.106362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:42:30.107999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:42:30.109575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 16:42:30.109575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.109575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9ae49f59-4258-4cec-afc6-60c6693ab09c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:30.109575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9ae49f59-4258-4cec-afc6-60c6693ab09c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009708 Sep 01 16:42:30.109575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 424/871] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Sep 1 16:42:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:42:30.113654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8468cb1c-5093-4689-8d3e-1b9972efd2bc tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Action: 'create', calling method: .version_select at 0x7f6c9cbd1e50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1758852663", "metadata": {"Type": "work"}}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8468cb1c-5093-4689-8d3e-1b9972efd2bc tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Request method failure captured: Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 119 Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOD15ojmttA3DeFR-s_8AQTuZN9Gg5x5efS_wA_c9yoISwRQJMasxEwE63_ZoWr4x5gJocQfXOgyOatUNJYvxm7rar5MxHbkGs6oyNINaSHZljTRC64FymgJnD8Rh0OTQsqM-LYxR1beT1J3XTdMeUI1KRnFjha5TosPXIHK9IK5P3M Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:30.118136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c38be99d56404657938612fa8c06999f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c38be99d56404657938612fa8c06999f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}] Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 6c5ce5557d60473f9b85373892ad5c8f Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1758852663", "metadata": {"Type": "work"}}} Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:42:30.119829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1758852663', 'metadata': {'Type': 'work'}}}} Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise error Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi '' Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:30.121376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 16:42:30.123127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 16:42:30.124451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 16:42:30.124451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.124451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8468cb1c-5093-4689-8d3e-1b9972efd2bc tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:30.124451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8468cb1c-5093-4689-8d3e-1b9972efd2bc tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009561 Sep 01 16:42:30.124451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 448/872] 10.222.0.58 () {60 vars in 1156 bytes} [Thu Sep 1 16:42:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:42:30.129715 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4dfac440-a341-4508-b1f2-e7af4a9f818c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Calling method '.version_select at 0x7f6c9ce46820>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:30.159966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-4dfac440-a341-4508-b1f2-e7af4a9f818c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] HTTP exception thrown: Volume tempest-invalid-2076730233 could not be found. Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4dfac440-a341-4508-b1f2-e7af4a9f818c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Request method failure captured: Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2076730233 HTTP/1.1 Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOD15ojmttA3DeFR-s_8AQTuZN9Gg5x5efS_wA_c9yoISwRQJMasxEwE63_ZoWr4x5gJocQfXOgyOatUNJYvxm7rar5MxHbkGs6oyNINaSHZljTRC64FymgJnD8Rh0OTQsqM-LYxR1beT1J3XTdMeUI1KRnFjha5TosPXIHK9IK5P3M Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:30.161890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c38be99d56404657938612fa8c06999f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c38be99d56404657938612fa8c06999f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}] Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 6c5ce5557d60473f9b85373892ad5c8f Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Volume tempest-invalid-2076730233 could not be found. Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'tempest-invalid-2076730233'} Sep 01 16:42:30.163487 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2076730233 could not be found. (HTTP 404) (Request-ID: req-c2bf91f3-9a95-4e41-8a82-d79cea0c8607) Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.164461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:42:30.165914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2076730233 could not be found. Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:30.167370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2076730233 could not be found. Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2076730233 could not be found. Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4dfac440-a341-4508-b1f2-e7af4a9f818c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Returning 404 to user: Volume tempest-invalid-2076730233 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4dfac440-a341-4508-b1f2-e7af4a9f818c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2076730233" status: 404 len: 99 microversion: 2.1 time: 0.037774 Sep 01 16:42:30.169344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 425/873] 10.222.0.58 () {58 vars in 1218 bytes} [Thu Sep 1 16:42:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2076730233 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 16:42:30.173397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-be5bc266-7a08-4d3c-a280-d4e6fd87fb5b tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003718 Sep 01 16:42:30.173894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 449/874] 10.222.0.58 () {58 vars in 1140 bytes} [Thu Sep 1 16:42:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:42:30.182055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-473bf346-2cff-4646-a033-9525fe14feb1 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003738 Sep 01 16:42:30.182576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 426/875] 10.222.0.58 () {58 vars in 1137 bytes} [Thu Sep 1 16:42:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 16:42:30.192565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bcbfbc73-e67f-425e-a3e8-adc24a8c37c5 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Calling method '.version_select at 0x7f6c9cbb8430>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:30.222030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-bcbfbc73-e67f-425e-a3e8-adc24a8c37c5 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] HTTP exception thrown: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bcbfbc73-e67f-425e-a3e8-adc24a8c37c5 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Request method failure captured: Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/os-volumes/b3514541-068c-4dc9-8fa5-6aff95f324b8 HTTP/1.1 Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOD15ojmttA3DeFR-s_8AQTuZN9Gg5x5efS_wA_c9yoISwRQJMasxEwE63_ZoWr4x5gJocQfXOgyOatUNJYvxm7rar5MxHbkGs6oyNINaSHZljTRC64FymgJnD8Rh0OTQsqM-LYxR1beT1J3XTdMeUI1KRnFjha5TosPXIHK9IK5P3M Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:30.223992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c38be99d56404657938612fa8c06999f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c38be99d56404657938612fa8c06999f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}] Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 6c5ce5557d60473f9b85373892ad5c8f Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'b3514541-068c-4dc9-8fa5-6aff95f324b8'} Sep 01 16:42:30.225551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. (HTTP 404) (Request-ID: req-8c791e4d-1686-42de-ab2d-1e29fedb40bc) Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.226542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 16:42:30.227909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 16:42:30.229262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bcbfbc73-e67f-425e-a3e8-adc24a8c37c5 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Returning 404 to user: Volume b3514541-068c-4dc9-8fa5-6aff95f324b8 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bcbfbc73-e67f-425e-a3e8-adc24a8c37c5 tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/b3514541-068c-4dc9-8fa5-6aff95f324b8" status: 404 len: 109 microversion: 2.1 time: 0.037493 Sep 01 16:42:30.231015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 450/876] 10.222.0.58 () {58 vars in 1248 bytes} [Thu Sep 1 16:42:30 2022] DELETE /compute/v2.1/os-volumes/b3514541-068c-4dc9-8fa5-6aff95f324b8 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:30.236437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-02d8cfb9-f41f-4b49-b68b-dd8dcdeffd7c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Calling method '.version_select at 0x7f6c9ce104c0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:30.264567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-02d8cfb9-f41f-4b49-b68b-dd8dcdeffd7c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] HTTP exception thrown: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-02d8cfb9-f41f-4b49-b68b-dd8dcdeffd7c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Request method failure captured: Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/os-volumes/5fcaa2df-c382-4c73-b819-3dd4ee99c55f HTTP/1.1 Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOD15ojmttA3DeFR-s_8AQTuZN9Gg5x5efS_wA_c9yoISwRQJMasxEwE63_ZoWr4x5gJocQfXOgyOatUNJYvxm7rar5MxHbkGs6oyNINaSHZljTRC64FymgJnD8Rh0OTQsqM-LYxR1beT1J3XTdMeUI1KRnFjha5TosPXIHK9IK5P3M Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:30.266522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c38be99d56404657938612fa8c06999f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c38be99d56404657938612fa8c06999f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c38be99d56404657938612fa8c06999f"}]}] Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: c38be99d56404657938612fa8c06999f Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesNegativeTest-1917241555 Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 6c5ce5557d60473f9b85373892ad5c8f Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesNegativeTest-1917241555-project Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '5fcaa2df-c382-4c73-b819-3dd4ee99c55f'} Sep 01 16:42:30.268296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. (HTTP 404) (Request-ID: req-8297770c-2011-41bd-8e3b-bf461d5149cf) Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.269313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 16:42:30.270982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 16:42:30.272180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-02d8cfb9-f41f-4b49-b68b-dd8dcdeffd7c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] Returning 404 to user: Volume 5fcaa2df-c382-4c73-b819-3dd4ee99c55f could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-02d8cfb9-f41f-4b49-b68b-dd8dcdeffd7c tempest-VolumesNegativeTest-1917241555 tempest-VolumesNegativeTest-1917241555-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/5fcaa2df-c382-4c73-b819-3dd4ee99c55f" status: 404 len: 109 microversion: 2.1 time: 0.035284 Sep 01 16:42:30.273604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 427/877] 10.222.0.58 () {58 vars in 1245 bytes} [Thu Sep 1 16:42:30 2022] GET /compute/v2.1/os-volumes/5fcaa2df-c382-4c73-b819-3dd4ee99c55f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:42:30.917698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51bc38b0-335c-4d04-a960-f630703e9cfc"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:30.920035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:30.926452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:30.926932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:30.927364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:30.928062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:30.928513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:30.928926 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:31.239138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ffcba027-d17c-40d2-8a80-a84988c00454 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "POST /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325885 Sep 01 16:42:31.239790 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 451/878] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:42:30 2022] POST /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:38.888830 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=27 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:38.889698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=5 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:38.894341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:38.894824 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:38.901657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.902136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.902598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.903275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:38.903721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:38.904140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:38.990225 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lazy-loading 'services' on Instance uuid b94c51b3-5e48-4015-a634-e5fe1eb2ff7e {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:39.062983 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-87205577-0b4a-4b1d-8339-17629a7dcce6 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments/51bc38b0-335c-4d04-a960-f630703e9cfc" status: 202 len: 0 microversion: 2.1 time: 0.176749 Sep 01 16:42:39.063591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 428/879] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:42:38 2022] DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments/51bc38b0-335c-4d04-a960-f630703e9cfc => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:39.073846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:39.076363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:39.082949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.083432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.083866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.084557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:39.084999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:39.085415 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:39.116345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e3d4b01b-8302-4cfe-8256-b1d4a79b7f14 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Sep 01 16:42:39.118111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 452/880] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:39 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:40.131151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:40.133465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:40.142756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.143249 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.143685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.144397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.144893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.145313 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.177136 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fc2b74e6-30f9-476f-ab94-ae0a934ad531 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050796 Sep 01 16:42:40.177816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 429/881] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:42:40 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:42:40.247655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:40.248144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:40.254723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.255207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.255644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.256334 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.256833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.257277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.284682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:42:40.360326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8905896c-f780-4872-9c52-76f53f89b71a tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 204 len: 0 microversion: 2.1 time: 0.117023 Sep 01 16:42:40.360919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 453/882] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:40 2022] DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:42:40.371126 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:40.372561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:40.379062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.379746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.380252 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.381037 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:40.381559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:40.382064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:40.518540 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:40.526551 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ebabbf7a-8055-4e7b-9d88-274f7e9ec568 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1681 microversion: 2.1 time: 0.159891 Sep 01 16:42:40.527115 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 430/883] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:40 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:41.548910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:41.550160 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:41.556649 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.557122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.557551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.558260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:41.558717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:41.559135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:41.714818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:41.723594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-751e72cd-65b1-4395-9fb2-425f15873e68 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1681 microversion: 2.1 time: 0.178682 Sep 01 16:42:41.738853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 454/884] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:41 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:42.752049 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:42.752653 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:42.759361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.759846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.760282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.761066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:42.761623 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:42.762052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:42.896107 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:42.912502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f8e2c74d-b51a-48d6-9d5b-ed832d7f1b37 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1681 microversion: 2.1 time: 0.163924 Sep 01 16:42:42.913203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 431/885] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:42 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:43.746567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-9ffff0a0-1613-4f0b-a705-90de7a0d30f0 req-753360f7-e337-46ed-91f1-8e73ba94d586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94c51b3-5e48-4015-a634-e5fe1eb2ff7e", "name": "network-vif-deleted", "tag": "88c81c32-f367-4507-8576-db444d596448"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:42:43.756950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:43.761771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9ffff0a0-1613-4f0b-a705-90de7a0d30f0 req-753360f7-e337-46ed-91f1-8e73ba94d586 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.762144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9ffff0a0-1613-4f0b-a705-90de7a0d30f0 req-753360f7-e337-46ed-91f1-8e73ba94d586 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.762764 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9ffff0a0-1613-4f0b-a705-90de7a0d30f0 req-753360f7-e337-46ed-91f1-8e73ba94d586 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.775839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-9ffff0a0-1613-4f0b-a705-90de7a0d30f0 req-753360f7-e337-46ed-91f1-8e73ba94d586 service nova] Creating event network-vif-deleted:88c81c32-f367-4507-8576-db444d596448 for instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e on hv-cinder-85220 Sep 01 16:42:43.782328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-9ffff0a0-1613-4f0b-a705-90de7a0d30f0 req-753360f7-e337-46ed-91f1-8e73ba94d586 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040525 Sep 01 16:42:43.783205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 455/886] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:42:43.940091 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:43.941693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:43.951071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.952011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.952731 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.953610 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:43.954363 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:43.955017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:43.999138 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:44.000009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:44.000460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:44.000903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lazy-loading 'fault' on Instance uuid b94c51b3-5e48-4015-a634-e5fe1eb2ff7e {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:42:44.052527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '024adeb8a8e14d678ae14174d9555152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5bb8b858e545b2bcede8b26a2188a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:42:44.062140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-37cfefe6-af93-4105-a422-ee657ad7ccda tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 200 len: 1332 microversion: 2.1 time: 0.126850 Sep 01 16:42:44.063502 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 432/887] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:43 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:42:45.086477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:45.087179 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:45.094240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:45.094721 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:45.095152 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.095988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:45.096546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:45.097004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:45.111364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e HTTP/1.1 Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:45.112986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:45.114787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'b94c51b3-5e48-4015-a634-e5fe1eb2ff7e'} Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:45.115739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:45.117352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:45.119132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:45.119132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4d640cf2-f1e2-40d8-9890-e16edf1614e7 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 404 len: 111 microversion: 2.1 time: 0.033148 Sep 01 16:42:45.119132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 456/888] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:45 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:45.124173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2fd4c044-74af-459d-be72-29ab329c5c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '.version_select at 0x7f6c9ce104c0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:45.128968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2fd4c044-74af-459d-be72-29ab329c5c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [a22810db-d710-4939-9531-3c8a7568db53] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:42:46.136011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [None req-2fd4c044-74af-459d-be72-29ab329c5c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [a22810db-d710-4939-9531-3c8a7568db53] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 54590. Sep 01 16:42:46.154546 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2fd4c044-74af-459d-be72-29ab329c5c7c tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462971412" status: 202 len: 0 microversion: 2.1 time: 1.034385 Sep 01 16:42:46.155384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 433/889] 10.222.0.58 () {58 vars in 1221 bytes} [Thu Sep 1 16:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462971412 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:42:47.933263 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:47.933784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:47.940516 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.940993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.941426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.942117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.942616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.943035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.956571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e HTTP/1.1 Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:47.958102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.959774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'b94c51b3-5e48-4015-a634-e5fe1eb2ff7e'} Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:47.963685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.965166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.967283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:47.967283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c503fc7a-c7d8-47d1-8452-a8cb90cc5a30 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 404 len: 111 microversion: 2.1 time: 0.030049 Sep 01 16:42:47.967283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 457/890] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:47 2022] DELETE /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:47.969105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:47.969773 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: b94c51b3-5e48-4015-a634-e5fe1eb2ff7e] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:47.976374 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.976859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.977295 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.977986 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:47.978480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:47.979105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:47.993895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e HTTP/1.1 Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:47.995613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.997212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'b94c51b3-5e48-4015-a634-e5fe1eb2ff7e'} Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:47.998128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. Sep 01 16:42:47.999644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:48.000992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance b94c51b3-5e48-4015-a634-e5fe1eb2ff7e could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:48.000992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-06b0b847-7783-4cbf-b46b-cfeb72144650 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e" status: 404 len: 111 microversion: 2.1 time: 0.032787 Sep 01 16:42:48.000992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 434/891] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:47 2022] GET /compute/v2.1/servers/b94c51b3-5e48-4015-a634-e5fe1eb2ff7e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:49.150291 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:49.150825 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:49.158359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.158841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.159277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.159967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.160422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.160846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.163662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:42:49.178980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd HTTP/1.1 Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:49.180844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.182556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': 'a859d3d7-ed03-4ba3-a475-9752cfb9e0bd'} Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:49.183392 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.185086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.188534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:49.188534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4586b79b-cf49-4597-bf09-f8922adc82fd tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 404 len: 111 microversion: 2.1 time: 0.035818 Sep 01 16:42:49.188534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 458/892] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:49 2022] DELETE /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:49.190994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:49.191618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: a859d3d7-ed03-4ba3-a475-9752cfb9e0bd] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:49.198668 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.199160 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.199597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.200302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.201328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.201775 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.215513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd HTTP/1.1 Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:49.217703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.219467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'a859d3d7-ed03-4ba3-a475-9752cfb9e0bd'} Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:49.220561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. Sep 01 16:42:49.222069 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.223536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance a859d3d7-ed03-4ba3-a475-9752cfb9e0bd could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:49.223536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e6695cfb-5c41-4616-9f9c-936283f18b61 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd" status: 404 len: 111 microversion: 2.1 time: 0.032174 Sep 01 16:42:49.223536 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 435/893] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:49 2022] GET /compute/v2.1/servers/a859d3d7-ed03-4ba3-a475-9752cfb9e0bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:49.228970 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:49.229465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:49.236026 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.236500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.236928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.237619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.238081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.238522 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.252230 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 HTTP/1.1 Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:49.253779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.255409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '9fb4c143-3275-49a0-8082-844006bf4340'} Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:49.256482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.258023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.260058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:49.260058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-80f4f438-4918-4b41-bc5f-b3406a09d883 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 404 len: 111 microversion: 2.1 time: 0.030063 Sep 01 16:42:49.260058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 459/894] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:49 2022] DELETE /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:49.264634 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:49.265242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 9fb4c143-3275-49a0-8082-844006bf4340] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:49.271437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.271924 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.272366 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.273063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:49.273517 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:49.273941 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:49.287678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 HTTP/1.1 Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:49.289196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.290899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '9fb4c143-3275-49a0-8082-844006bf4340'} Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:49.291723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. Sep 01 16:42:49.292994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:49.294266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance 9fb4c143-3275-49a0-8082-844006bf4340 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:49.294266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-62438cea-b5f4-4aae-909b-79f2c46f0143 tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340" status: 404 len: 111 microversion: 2.1 time: 0.030821 Sep 01 16:42:49.294266 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 436/895] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:49 2022] GET /compute/v2.1/servers/9fb4c143-3275-49a0-8082-844006bf4340 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:50.429644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:50.430126 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:50.436772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.437249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.437677 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.438409 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.438850 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.439266 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.453064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 HTTP/1.1 Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:42:50.454606 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.456232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '6f025a61-b696-4513-bf6f-c598683e0740'} Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:50.457313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.459205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.460789 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:50.460789 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-94d62b23-a6c9-468e-8da0-7cdb5823d72f tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 404 len: 111 microversion: 2.1 time: 0.030123 Sep 01 16:42:50.460789 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 460/896] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:42:50 2022] DELETE /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:42:50.464629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:42:50.465270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] [instance: 6f025a61-b696-4513-bf6f-c598683e0740] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:42:50.472797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.473273 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.473703 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.474431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:42:50.474880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:42:50.475297 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:42:50.489078 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] HTTP exception thrown: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Request method failure captured: Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 HTTP/1.1 Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5CjZ9r0v4NFbuRU-LNzVFPGH8pe-l9rVon075WxHO0OzSB7TkBuS71jfQJXKYuOt-BeBGPoAM1SMvohgWplvVswKpDGI0DJ2KCCgeBKSfEc6Mgu1qWGAeYudlYlwUcXiprBgiO_QhHhbuWE-jthKllPsviDmVYMHM02AikMBWWlhU Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:42:50.490605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d5bb8b858e545b2bcede8b26a2188a3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d5bb8b858e545b2bcede8b26a2188a3"}]}] Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 7d5bb8b858e545b2bcede8b26a2188a3 Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1931190973 Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 024adeb8a8e14d678ae14174d9555152 Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeNegativeTest-1931190973-project Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.492264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '6f025a61-b696-4513-bf6f-c598683e0740'} Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:42:50.493428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. Sep 01 16:42:50.495047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:42:50.496777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] Returning 404 to user: Instance 6f025a61-b696-4513-bf6f-c598683e0740 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:42:50.496777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-467e3063-ddaf-4c0e-9684-7bb23d94452b tempest-AttachVolumeNegativeTest-1931190973 tempest-AttachVolumeNegativeTest-1931190973-project] 10.222.0.58 "GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740" status: 404 len: 111 microversion: 2.1 time: 0.031281 Sep 01 16:42:50.496777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 437/897] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:42:50 2022] GET /compute/v2.1/servers/6f025a61-b696-4513-bf6f-c598683e0740 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:35.431830 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:35.433969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:35.436644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=11 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.437287 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=5 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.443812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.444286 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.444714 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.445391 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.445836 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.446278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.474728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b4aaf92c-7ca0-430e-9e2e-827246bb1c4a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047165 Sep 01 16:43:35.475728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 461/898] 10.222.0.58 () {60 vars in 1343 bytes} [Thu Sep 1 16:43:35 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:35.536042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:35.536553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:35.538601 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:43:35.538737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:43:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 (ip 10.222.0.58) !!! Sep 01 16:43:35.539801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.540452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:35.548210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.548682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.549140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.549822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.550299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.550723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.579991 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:35.650938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c0ac4630-5dbf-4587-9644-384516669c8a tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 204 len: 0 microversion: 2.20 time: 0.118795 Sep 01 16:43:35.651533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 438/899] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Sep 1 16:43:35 2022] DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:43:35.660055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:35.660657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:35.667058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.667535 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.667973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.668633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:35.669077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:35.669493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:35.801774 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:35.810495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:35.811943 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:35.813100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f6732750-1173-4af9-89e8-e335468db9fb tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.157141 Sep 01 16:43:35.813659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 462/900] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:35 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:36.836328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:36.837016 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:36.843493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:36.843967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:36.844398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:36.845074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:36.845520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:36.845957 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:36.972695 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:36.980683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:36.982106 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:36.983370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c1af23d1-9289-4728-bd30-5ea9ee5edb82 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.151298 Sep 01 16:43:36.983914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 439/901] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:36 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:37.439602 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2026176098", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "networks": [{"uuid": "691eac48-8686-4579-85e4-bcf7933079ad"}]}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:37.497330 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] validate_networks() for [('691eac48-8686-4579-85e4-bcf7933079ad', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:43:37.908454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:43:37.908865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:43:37.909543 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:43:37.910159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:43:37.910599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:43:37.920776 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.921255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.921687 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.922434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:37.922885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:37.923301 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:37.943076 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Getting quotas for project ca311e408a714ede8d413375ca68eb67. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:43:37.947713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Getting quotas for user 3fbb843ada72400e9d9f06521c2a61ab and project ca311e408a714ede8d413375ca68eb67. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:43:37.960367 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:43:37.962768 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:43:38.007837 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:38.009548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:38.014644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8e5b0a1f-b148-4010-bd59-6f90d7343e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579048 Sep 01 16:43:38.015498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 463/902] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:43:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:43:38.017645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.018401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.019396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.020499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:38.021587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:38.022270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:38.029298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1ee0d0ba-a070-461b-ad6f-8c877baec813 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:38.029923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1ee0d0ba-a070-461b-ad6f-8c877baec813 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:38.092824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1ee0d0ba-a070-461b-ad6f-8c877baec813 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:38.104489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1ee0d0ba-a070-461b-ad6f-8c877baec813 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1214 microversion: 2.1 time: 0.080729 Sep 01 16:43:38.115552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 464/903] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:38 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:38.211133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:38.223290 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:38.225980 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:38.227405 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b46bb8bb-1178-4425-9d72-841cc67128e0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1725 microversion: 2.20 time: 0.223575 Sep 01 16:43:38.227967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 440/904] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:38 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 16:43:39.125065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:39.125738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:39.133810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.134345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.134783 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.135500 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.135940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.136362 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.205005 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-06ccd041-2547-46bf-ba86-978c306dabbe req-acf7d7e5-9d12-479c-9f25-2386018b10ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f7ceea3-a902-40ec-94f1-4a2c736f2c23", "name": "network-vif-deleted", "tag": "526f4514-26c0-4b58-918a-efbcf230a662"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:39.206556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.215337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b7085a2e-4f52-416e-8b3b-36898e2f5c8a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1266 microversion: 2.1 time: 0.094230 Sep 01 16:43:39.216034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-06ccd041-2547-46bf-ba86-978c306dabbe req-acf7d7e5-9d12-479c-9f25-2386018b10ca service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.216312 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 441/905] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:39 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:39.217000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-06ccd041-2547-46bf-ba86-978c306dabbe req-acf7d7e5-9d12-479c-9f25-2386018b10ca service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.217595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-06ccd041-2547-46bf-ba86-978c306dabbe req-acf7d7e5-9d12-479c-9f25-2386018b10ca service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.229661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-06ccd041-2547-46bf-ba86-978c306dabbe req-acf7d7e5-9d12-479c-9f25-2386018b10ca service nova] Creating event network-vif-deleted:526f4514-26c0-4b58-918a-efbcf230a662 for instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 on hv-cinder-85220 Sep 01 16:43:39.235062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-06ccd041-2547-46bf-ba86-978c306dabbe req-acf7d7e5-9d12-479c-9f25-2386018b10ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184491 Sep 01 16:43:39.235670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 465/906] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:39.253112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:39.253965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:39.262757 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.263246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.263866 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.264774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:39.265236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:39.265660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:39.328567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.337038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.338503 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:39.339733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e84ffb47-d325-4364-b05d-ff8ccefa9222 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1367 microversion: 2.20 time: 0.090647 Sep 01 16:43:39.340300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 442/907] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:39 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1367 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:40.237414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:40.238433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:40.250634 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.251329 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.251770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.252468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.253146 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.253651 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.332526 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.340843 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d58e276b-dd54-4695-81c8-9bd769545d1d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1272 microversion: 2.1 time: 0.108102 Sep 01 16:43:40.341394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 466/908] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:40 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:40.363912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:40.364541 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:40.371411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.371897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.372332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.373091 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.373771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.374230 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.415575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:40.416059 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:40.416495 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:40.416999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lazy-loading 'fault' on Instance uuid 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:43:40.472291 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.480506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.482080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a328e946d6d4441ca7ecbb3a20d2a611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f3ba5ae75246ec9237a7e2305ae32a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:40.483354 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2359e53e-8e7d-46fe-87ad-13135a174a0c tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 200 len: 1372 microversion: 2.20 time: 0.123477 Sep 01 16:43:40.484002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 443/909] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:40 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 1372 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 16:43:41.334466 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-3f5f4006-e038-465a-a14e-26f0df41675f req-522099f8-1591-47e9-94e8-c725e41da3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f24fe6-74bf-40d9-8f29-d23e63fa6abf", "tag": "d6d069f6-e886-48b1-b2c7-eb96b64efa32"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:41.346005 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-3f5f4006-e038-465a-a14e-26f0df41675f req-522099f8-1591-47e9-94e8-c725e41da3e0 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.346742 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-3f5f4006-e038-465a-a14e-26f0df41675f req-522099f8-1591-47e9-94e8-c725e41da3e0 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.347326 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-3f5f4006-e038-465a-a14e-26f0df41675f req-522099f8-1591-47e9-94e8-c725e41da3e0 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.359735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-3f5f4006-e038-465a-a14e-26f0df41675f req-522099f8-1591-47e9-94e8-c725e41da3e0 service nova] Creating event network-changed:d6d069f6-e886-48b1-b2c7-eb96b64efa32 for instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf on hv-cinder-85220 Sep 01 16:43:41.361798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:41.362648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:41.364859 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-3f5f4006-e038-465a-a14e-26f0df41675f req-522099f8-1591-47e9-94e8-c725e41da3e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034627 Sep 01 16:43:41.365457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 467/910] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:41.369898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.370420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.370776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.371507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.371961 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.372380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.507822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:41.508519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:41.508833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:41.515356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.515844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.516304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.517004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:41.517116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-750f4d7c-2524-4b8f-80ea-3eb80cb515a1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.159377 Sep 01 16:43:41.517460 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:41.517592 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 444/911] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:41 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:41.517884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:41.534623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] HTTP exception thrown: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Request method failure captured: Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 HTTP/1.1 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5Fl4ZhRzaelJmb_XXzRs_sKWuyH2SR3XNz4n7-5P9YPstZgUjM-d6MxDFtuSGbzQDQHNkDssUWBCNSbkYdknh9AzAr2UChUPshjBbvwGVqiyGCD4A8Df38NRzo5GwgMn2IYX5waaaU1vQlwA1OfNSxMSCaYt_7ijiYEr96K_7LgD0 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:43:41.536280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10f3ba5ae75246ec9237a7e2305ae32a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}] Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: a328e946d6d4441ca7ecbb3a20d2a611 Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:41.538435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '7f7ceea3-a902-40ec-94f1-4a2c736f2c23'} Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:41.539283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:41.541952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:41.543641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Returning 404 to user: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:41.543641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6829342b-9f65-4b3f-9e14-e3535b4f4fa0 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 404 len: 111 microversion: 2.20 time: 0.035402 Sep 01 16:43:41.543641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 468/912] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:41 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 16:43:41.548854 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e13ad9f8-d5bb-4da7-aa50-57c9a8885437 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '.version_select at 0x7f6c9cce6dc0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:41.568328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e13ad9f8-d5bb-4da7-aa50-57c9a8885437 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574445053" status: 204 len: 0 microversion: 2.20 time: 0.023157 Sep 01 16:43:41.568817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 445/913] 10.222.0.58 () {60 vars in 1262 bytes} [Thu Sep 1 16:43:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574445053 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 16:43:42.540306 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:42.541077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:42.547803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.548291 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.548723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.549454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:42.549905 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:42.550359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:42.703013 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:42.711576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ed00cb3e-3940-489b-923c-240b34e1f83b tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.175217 Sep 01 16:43:42.712140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 469/914] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:42 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:43:43.377794 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.378309 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.385087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.385564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.385999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.386718 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.387173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.387600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.400738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] HTTP exception thrown: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Request method failure captured: Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 HTTP/1.1 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5Fl4ZhRzaelJmb_XXzRs_sKWuyH2SR3XNz4n7-5P9YPstZgUjM-d6MxDFtuSGbzQDQHNkDssUWBCNSbkYdknh9AzAr2UChUPshjBbvwGVqiyGCD4A8Df38NRzo5GwgMn2IYX5waaaU1vQlwA1OfNSxMSCaYt_7ijiYEr96K_7LgD0 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:43:43.402483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10f3ba5ae75246ec9237a7e2305ae32a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}] Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: a328e946d6d4441ca7ecbb3a20d2a611 Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.404145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '7f7ceea3-a902-40ec-94f1-4a2c736f2c23'} Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:43.405141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.406666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.408510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Returning 404 to user: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:43.408510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-471ee5d5-7b34-4583-86b7-1d41566a8f15 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 404 len: 111 microversion: 2.20 time: 0.030473 Sep 01 16:43:43.408510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 446/915] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Sep 1 16:43:43 2022] DELETE /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:43.413067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.413693 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 7f7ceea3-a902-40ec-94f1-4a2c736f2c23] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.419720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.420201 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.420637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.421320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.421776 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.422222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.587115 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] HTTP exception thrown: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Request method failure captured: Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 HTTP/1.1 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5Fl4ZhRzaelJmb_XXzRs_sKWuyH2SR3XNz4n7-5P9YPstZgUjM-d6MxDFtuSGbzQDQHNkDssUWBCNSbkYdknh9AzAr2UChUPshjBbvwGVqiyGCD4A8Df38NRzo5GwgMn2IYX5waaaU1vQlwA1OfNSxMSCaYt_7ijiYEr96K_7LgD0 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:43:43.588652 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10f3ba5ae75246ec9237a7e2305ae32a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}] Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: a328e946d6d4441ca7ecbb3a20d2a611 Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.590437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '7f7ceea3-a902-40ec-94f1-4a2c736f2c23'} Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:43.591574 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. Sep 01 16:43:43.593065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:43.594537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Returning 404 to user: Instance 7f7ceea3-a902-40ec-94f1-4a2c736f2c23 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:43.594537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4093e13d-bc87-4294-9e16-e819d0c3c8ac tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23" status: 404 len: 111 microversion: 2.20 time: 0.181684 Sep 01 16:43:43.594537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 470/916] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:43 2022] GET /compute/v2.1/servers/7f7ceea3-a902-40ec-94f1-4a2c736f2c23 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:43.731822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:43.732433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:43.738412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.738897 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.739345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.740068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:43.740527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:43.741001 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:43.873271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:43.880974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a5ae9fe2-f86b-439e-b8ef-5429018f68cb tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.153069 Sep 01 16:43:43.881534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 447/917] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:43 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:44.731854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:44.732715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:44.739565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.740737 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.741242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.741936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.742430 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.742848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.756498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] HTTP exception thrown: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Request method failure captured: Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 HTTP/1.1 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEN5Fl4ZhRzaelJmb_XXzRs_sKWuyH2SR3XNz4n7-5P9YPstZgUjM-d6MxDFtuSGbzQDQHNkDssUWBCNSbkYdknh9AzAr2UChUPshjBbvwGVqiyGCD4A8Df38NRzo5GwgMn2IYX5waaaU1vQlwA1OfNSxMSCaYt_7ijiYEr96K_7LgD0 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:43:44.758039 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10f3ba5ae75246ec9237a7e2305ae32a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}] Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: a328e946d6d4441ca7ecbb3a20d2a611 Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.759770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '12bc543d-2b3a-4cf9-a341-42e36cea6368'} Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:44.763510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.764969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.766647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Returning 404 to user: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:44.766647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b01dab40-a3ca-4063-9b33-8d58ff6fe5e1 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 404 len: 111 microversion: 2.20 time: 0.031522 Sep 01 16:43:44.766647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 471/918] 10.222.0.58 () {60 vars in 1280 bytes} [Thu Sep 1 16:43:44 2022] DELETE /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:44.769919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:44.770582 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] [instance: 12bc543d-2b3a-4cf9-a341-42e36cea6368] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:44.776958 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.777431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.777858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.778576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.779025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.779441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.793527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] HTTP exception thrown: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Request method failure captured: Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 HTTP/1.1 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEN5Fl4ZhRzaelJmb_XXzRs_sKWuyH2SR3XNz4n7-5P9YPstZgUjM-d6MxDFtuSGbzQDQHNkDssUWBCNSbkYdknh9AzAr2UChUPshjBbvwGVqiyGCD4A8Df38NRzo5GwgMn2IYX5waaaU1vQlwA1OfNSxMSCaYt_7ijiYEr96K_7LgD0 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:43:44.795147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_10f3ba5ae75246ec9237a7e2305ae32a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/10f3ba5ae75246ec9237a7e2305ae32a"}]}] Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 10f3ba5ae75246ec9237a7e2305ae32a Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1192850501 Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: a328e946d6d4441ca7ecbb3a20d2a611 Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1192850501-project Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.796919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '12bc543d-2b3a-4cf9-a341-42e36cea6368'} Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:44.797744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. Sep 01 16:43:44.799203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:44.800995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] Returning 404 to user: Instance 12bc543d-2b3a-4cf9-a341-42e36cea6368 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:44.800995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-732cf5d5-eb7f-42e0-b17b-74105df7d3d5 tempest-AttachVolumeShelveTestJSON-1192850501 tempest-AttachVolumeShelveTestJSON-1192850501-project] 10.222.0.58 "GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368" status: 404 len: 111 microversion: 2.20 time: 0.031627 Sep 01 16:43:44.800995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 448/919] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Sep 1 16:43:44 2022] GET /compute/v2.1/servers/12bc543d-2b3a-4cf9-a341-42e36cea6368 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 16:43:44.901079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:44.901783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:44.908213 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.909171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.909772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:44.910710 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:44.911171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:44.911597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:45.047188 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:45.054059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2d40d6b3-7d7a-4659-bb55-53f98b0d0795 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.157013 Sep 01 16:43:45.054770 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 472/920] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:44 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:46.074894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:46.075612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:46.082166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.082683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.083121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.083849 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:46.084306 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:46.084729 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:46.215592 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:46.223293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ad022150-5540-4564-b057-45627a04c566 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.152313 Sep 01 16:43:46.225179 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 449/921] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:46 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:47.245015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:47.245757 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:47.252382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.252937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.253380 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.254073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:47.254554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:47.255028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:47.407259 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:47.416883 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0ab179f0-3ccc-4ce6-a419-bb2cac139cb1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.176310 Sep 01 16:43:47.417542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 473/922] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:47 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:48.441385 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:48.442041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:48.452242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:48.452812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:48.453261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:48.453971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:48.454448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:48.455059 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:48.594290 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:48.602770 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a5cf9383-d47a-493f-9c29-a1fb0842e6f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.165737 Sep 01 16:43:48.603532 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 450/923] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:48 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:48.677702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:48.679913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=8 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:48.869701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-9b122344-afb4-441c-823f-406864ec9d3a req-3d642290-b595-45a3-a972-25441f630e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f24fe6-74bf-40d9-8f29-d23e63fa6abf", "name": "network-vif-plugged", "status": "completed", "tag": "d6d069f6-e886-48b1-b2c7-eb96b64efa32"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:48.879364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9b122344-afb4-441c-823f-406864ec9d3a req-3d642290-b595-45a3-a972-25441f630e28 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:48.879840 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9b122344-afb4-441c-823f-406864ec9d3a req-3d642290-b595-45a3-a972-25441f630e28 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:48.880351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-9b122344-afb4-441c-823f-406864ec9d3a req-3d642290-b595-45a3-a972-25441f630e28 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:48.891181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-9b122344-afb4-441c-823f-406864ec9d3a req-3d642290-b595-45a3-a972-25441f630e28 service nova] Creating event network-vif-plugged:d6d069f6-e886-48b1-b2c7-eb96b64efa32 for instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf on hv-cinder-85220 Sep 01 16:43:48.896156 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-9b122344-afb4-441c-823f-406864ec9d3a req-3d642290-b595-45a3-a972-25441f630e28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223822 Sep 01 16:43:48.897463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 474/924] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:49.625791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:49.626757 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:49.636967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:49.638066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:49.638906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:49.639988 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:49.640542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:49.642276 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:49.780444 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:49.792066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f694a654-4778-4387-ad41-3b924cf63417 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.171181 Sep 01 16:43:49.792662 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 451/925] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:49 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:50.815333 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:50.816779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:50.824048 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.824501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.824929 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:50.825612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:50.826056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:50.826672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:51.053153 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:51.061275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1ac99fa5-5fbf-4663-a24b-1f011f03ff06 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1314 microversion: 2.1 time: 0.250222 Sep 01 16:43:51.062411 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 475/926] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:50 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:52.084580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:52.085195 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:52.091964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:52.092452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:52.092887 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:52.093593 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:52.094047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:52.094518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:52.520614 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:52.529254 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a2cc9478-e8cd-432c-8f21-710c79d99e9a tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1498 microversion: 2.1 time: 0.448591 Sep 01 16:43:52.529822 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 452/927] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:52 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1498 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:53.078154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:53.078768 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:53.085062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:53.085542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:53.085973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:53.086694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:53.087149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:53.087572 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:53.114358 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:43:53.195313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e2feb176-ddf9-4255-83c0-aa88b2e5cf73 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "DELETE /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 204 len: 0 microversion: 2.1 time: 0.120671 Sep 01 16:43:53.196223 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 476/928] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:43:53 2022] DELETE /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:43:53.204274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:53.204867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:53.211338 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:53.211819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:53.212253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:53.212944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:53.213398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:53.213821 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:53.351609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:53.359880 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c97c51f8-6eae-4a0e-95f2-878f800617cc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1504 microversion: 2.1 time: 0.159455 Sep 01 16:43:53.360485 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 453/929] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:53 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:54.381205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:54.382559 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:54.389395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:54.389951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:54.390474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:54.391562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:54.392009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:54.392586 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:54.525344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:54.533423 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b9b82ab1-8226-4f31-b4f1-ffa939138199 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1504 microversion: 2.1 time: 0.156465 Sep 01 16:43:54.533995 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 477/930] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:54 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:55.555793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:55.556401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:55.562893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.563374 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.563903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.564629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.565087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.565510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.696133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:55.699805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:43:55.705236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-06f1c1d2-a2ac-498c-840b-9c136d70422d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 200 len: 1504 microversion: 2.1 time: 0.153845 Sep 01 16:43:55.705819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 454/931] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:55 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:55.867969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-0ab800bb-82de-4697-bc80-be25f5936f97 req-76a20085-f5dd-490a-92f2-fe0baaaa8914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f24fe6-74bf-40d9-8f29-d23e63fa6abf", "name": "network-vif-deleted", "tag": "d6d069f6-e886-48b1-b2c7-eb96b64efa32"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:55.879543 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-0ab800bb-82de-4697-bc80-be25f5936f97 req-76a20085-f5dd-490a-92f2-fe0baaaa8914 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:55.880021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-0ab800bb-82de-4697-bc80-be25f5936f97 req-76a20085-f5dd-490a-92f2-fe0baaaa8914 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:55.880488 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-0ab800bb-82de-4697-bc80-be25f5936f97 req-76a20085-f5dd-490a-92f2-fe0baaaa8914 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:55.892406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-0ab800bb-82de-4697-bc80-be25f5936f97 req-76a20085-f5dd-490a-92f2-fe0baaaa8914 service nova] Creating event network-vif-deleted:d6d069f6-e886-48b1-b2c7-eb96b64efa32 for instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf on hv-cinder-85220 Sep 01 16:43:55.897678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-0ab800bb-82de-4697-bc80-be25f5936f97 req-76a20085-f5dd-490a-92f2-fe0baaaa8914 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033748 Sep 01 16:43:55.898491 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 478/932] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:43:56.726772 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:56.727412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 22f24fe6-74bf-40d9-8f29-d23e63fa6abf] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:56.734564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:56.735046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:56.735478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:56.736188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:56.736644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:56.737064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:56.751720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] HTTP exception thrown: Instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf could not be found. Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Request method failure captured: Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf HTTP/1.1 Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOE1HhL5AyjfoRRB9doU4W4517e52B_cjQ0y95noWn1fZDOyCkxObA3eh3vOZfrvBJzwQTY8ove6YLlYNIBIbt0KfBHULaER8YJS9t1b2AWUl4I19GCMCdqoa0XVu9aKajznvsnyzQW1zzMxs-oicBZ2poiVGUMu5HeaBqTUaiyo0Eg Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: ca311e408a714ede8d413375ca68eb67 Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesActionsTest-1944222307 Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:43:56.753223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca311e408a714ede8d413375ca68eb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca311e408a714ede8d413375ca68eb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca311e408a714ede8d413375ca68eb67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca311e408a714ede8d413375ca68eb67"}]}] Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesActionsTest-1944222307 Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: ca311e408a714ede8d413375ca68eb67 Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesActionsTest-1944222307 Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesActionsTest-1944222307-project Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 3fbb843ada72400e9d9f06521c2a61ab Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesActionsTest-1944222307-project Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf could not be found. Sep 01 16:43:56.754903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '22f24fe6-74bf-40d9-8f29-d23e63fa6abf'} Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf could not be found. Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:43:56.755810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf could not be found. Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf could not be found. Sep 01 16:43:56.757302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:43:56.758694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Returning 404 to user: Instance 22f24fe6-74bf-40d9-8f29-d23e63fa6abf could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:43:56.758694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-43dbd190-cabb-45b6-91e5-52c9b134bc82 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf" status: 404 len: 111 microversion: 2.1 time: 0.032546 Sep 01 16:43:56.758694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 455/933] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:56 2022] GET /compute/v2.1/servers/22f24fe6-74bf-40d9-8f29-d23e63fa6abf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:43:56.851079 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1436573469", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "networks": [{"uuid": "691eac48-8686-4579-85e4-bcf7933079ad"}]}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:43:56.902594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] validate_networks() for [('691eac48-8686-4579-85e4-bcf7933079ad', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:43:57.248414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:43:57.248818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:43:57.249294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:43:57.249694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:43:57.250097 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:43:57.261060 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:57.261474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:57.261904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:57.262655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:57.263106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:57.263527 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:57.280351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Getting quotas for project ca311e408a714ede8d413375ca68eb67. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:43:57.284862 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Getting quotas for user 3fbb843ada72400e9d9f06521c2a61ab and project ca311e408a714ede8d413375ca68eb67. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:43:57.296267 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:43:57.298649 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:43:57.342945 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2bac94ae-54b7-4532-abe5-248e78bacb3c tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496537 Sep 01 16:43:57.343696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 479/934] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:43:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:43:57.355160 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-00c0bee0-a636-45d5-a6d9-fc48cecf38c2 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:57.355777 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-00c0bee0-a636-45d5-a6d9-fc48cecf38c2 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:57.409879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-00c0bee0-a636-45d5-a6d9-fc48cecf38c2 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:57.417556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-00c0bee0-a636-45d5-a6d9-fc48cecf38c2 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1214 microversion: 2.1 time: 0.066270 Sep 01 16:43:57.418155 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 456/935] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:57 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:58.437176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:58.437778 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:58.445539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.446011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.446464 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.447140 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:58.447585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:58.448001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:58.508995 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:58.516571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0602164f-4169-4404-b20b-53a4e1a06ff6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1266 microversion: 2.1 time: 0.083268 Sep 01 16:43:58.517130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 480/936] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:58 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:43:59.539436 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:43:59.540601 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:43:59.548419 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:59.548911 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:59.549350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:59.550048 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:43:59.550538 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:43:59.550969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:43:59.615343 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:43:59.623084 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c7cb0838-1beb-4abc-933b-e18f93a197ed tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1266 microversion: 2.1 time: 0.089130 Sep 01 16:43:59.623654 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 457/937] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:43:59 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:00.645277 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:00.645794 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:00.652324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:00.652803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:00.653236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:00.653921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:00.654403 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:00.654826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:00.717951 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:00.726057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-311a964b-3151-49ad-a705-29e8a1dd86bc tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1266 microversion: 2.1 time: 0.084208 Sep 01 16:44:00.726655 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 481/938] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:00 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:01.746876 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:01.747508 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:01.754052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:01.754565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:01.755002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:01.755688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:01.756144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:01.756568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:01.820196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:01.827833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3dbc6079-1f5f-47ee-8d82-563f6c48e1fe tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1266 microversion: 2.1 time: 0.084836 Sep 01 16:44:01.828396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 458/939] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:01 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:02.848306 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:02.849206 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:02.856033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:02.856509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:02.856937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:02.857615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:02.858063 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:02.858515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:03.049948 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:03.053689 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:03.060779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6d40d406-5bff-4142-bf48-41163404f765 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.216241 Sep 01 16:44:03.062320 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 482/940] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:02 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:03.331229 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-db66ed3d-04ca-4482-9fbd-6830569ddb5b req-22e72cd2-3e30-4957-8f57-f721b5db95ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bc34ec-8598-44a8-8149-ba513b774112", "tag": "a9b46bb0-2f9e-4273-a9ee-899f7e33cdef"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:03.346159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-db66ed3d-04ca-4482-9fbd-6830569ddb5b req-22e72cd2-3e30-4957-8f57-f721b5db95ce service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:03.346944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-db66ed3d-04ca-4482-9fbd-6830569ddb5b req-22e72cd2-3e30-4957-8f57-f721b5db95ce service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:03.347433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-db66ed3d-04ca-4482-9fbd-6830569ddb5b req-22e72cd2-3e30-4957-8f57-f721b5db95ce service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:03.361187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-db66ed3d-04ca-4482-9fbd-6830569ddb5b req-22e72cd2-3e30-4957-8f57-f721b5db95ce service nova] Creating event network-changed:a9b46bb0-2f9e-4273-a9ee-899f7e33cdef for instance 74bc34ec-8598-44a8-8149-ba513b774112 on hv-cinder-85220 Sep 01 16:44:03.366676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-db66ed3d-04ca-4482-9fbd-6830569ddb5b req-22e72cd2-3e30-4957-8f57-f721b5db95ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044585 Sep 01 16:44:03.367795 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 459/941] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:04.082612 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:04.083214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:04.091347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:04.091821 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:04.092251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:04.092927 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:04.093372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:04.093787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:04.222899 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:04.230410 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f5481e6e-2a13-4ed6-9a80-7b9eb38809a0 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.151987 Sep 01 16:44:04.230966 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 483/942] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:04 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:05.251422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:05.252158 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:05.259121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:05.259605 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:05.260040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:05.260728 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:05.261183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:05.261610 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:05.394453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:05.402620 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fe62b3f9-1adb-49e5-9651-28338b19593d tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.155488 Sep 01 16:44:05.403191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 460/943] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:05 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:06.423040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:06.423724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:06.426332 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:06.431712 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.432319 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.432885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.433661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:06.434111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:06.434568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:06.579810 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:06.589163 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8f93dcc6-22ba-42d8-8166-906bd6856bb5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.170050 Sep 01 16:44:06.589741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 484/944] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:06 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:07.609877 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:07.610499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:07.612949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:07.613710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:07.619866 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:07.620341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:07.620764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:07.621441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:07.621891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:07.622335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:07.754474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:07.762135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-348b045a-562f-48d7-a387-a609495efef1 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.156089 Sep 01 16:44:07.762723 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 461/945] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:07 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:08.784542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:08.785163 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:08.787335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.788279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:44:08.795291 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:08.795804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:08.796348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:08.797118 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:08.797658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:08.798096 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:08.939876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:08.948012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-aa002903-b150-4f8c-b8b4-980b7faf1d0f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.167658 Sep 01 16:44:08.948580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 485/946] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:08 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:09.967998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:09.968623 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:09.975098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.975578 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.976014 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:09.976709 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:09.977798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:09.978243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:10.114283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:10.122744 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-10c01e85-d0af-4e3e-93fa-3b9ad0f43534 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.158545 Sep 01 16:44:10.123310 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 462/947] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:09 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:10.589241 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-ad237c49-ad31-4da2-9927-c794f09fd3b4 req-a0175ae8-940e-469b-ba92-af43fa209a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bc34ec-8598-44a8-8149-ba513b774112", "name": "network-vif-plugged", "status": "completed", "tag": "a9b46bb0-2f9e-4273-a9ee-899f7e33cdef"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:10.601221 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-ad237c49-ad31-4da2-9927-c794f09fd3b4 req-a0175ae8-940e-469b-ba92-af43fa209a0d service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:10.601713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-ad237c49-ad31-4da2-9927-c794f09fd3b4 req-a0175ae8-940e-469b-ba92-af43fa209a0d service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:10.602152 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-ad237c49-ad31-4da2-9927-c794f09fd3b4 req-a0175ae8-940e-469b-ba92-af43fa209a0d service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:10.613021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-ad237c49-ad31-4da2-9927-c794f09fd3b4 req-a0175ae8-940e-469b-ba92-af43fa209a0d service nova] Creating event network-vif-plugged:a9b46bb0-2f9e-4273-a9ee-899f7e33cdef for instance 74bc34ec-8598-44a8-8149-ba513b774112 on hv-cinder-85220 Sep 01 16:44:10.619183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-ad237c49-ad31-4da2-9927-c794f09fd3b4 req-a0175ae8-940e-469b-ba92-af43fa209a0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033124 Sep 01 16:44:10.620138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 486/948] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:11.143843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:11.144393 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:11.151464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:11.151945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:11.152381 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:11.153074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:11.153529 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:11.153953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:11.291026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:11.300074 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d1707698-415b-43de-88e0-9f46d1bf383f tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1314 microversion: 2.1 time: 0.160183 Sep 01 16:44:11.300754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 463/949] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:11 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:12.321545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:12.322188 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:12.329551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.330082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.330550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.331237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:12.331693 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:12.332113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:12.464601 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:12.472701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d9fdbb6d-0c97-43f7-88b6-a5b6a561b42e tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1498 microversion: 2.1 time: 0.155358 Sep 01 16:44:12.473177 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 487/950] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:12 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:13.052592 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:13.053093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:13.060506 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.060974 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.061415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.062110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.063178 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.063644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.089631 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:44:13.162754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-de00594c-e187-4934-aafb-845ff057ad67 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "DELETE /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 204 len: 0 microversion: 2.1 time: 0.113820 Sep 01 16:44:13.163453 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 464/951] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:44:13 2022] DELETE /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:44:13.172389 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:13.173003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:13.179037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.179519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.179954 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.181387 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:13.181848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:13.182312 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:13.322021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:13.329992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-af683f51-1bb6-417d-b8ae-df16ceb6b4e5 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1504 microversion: 2.1 time: 0.161634 Sep 01 16:44:13.330594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 488/952] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:13 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:14.351394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:14.352019 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:14.359025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:14.359588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:14.360079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:14.362467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:14.362935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:14.363368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:14.495886 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:14.503694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-64ef1e17-f4d8-4ffe-a323-2f0be2153491 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1504 microversion: 2.1 time: 0.156628 Sep 01 16:44:14.504268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 465/953] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:14 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:15.443761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-cd56d02c-eed6-4c09-9fc5-fe8c10cf6c9c req-935f5cc2-7812-4b43-8d95-ac03225e5d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bc34ec-8598-44a8-8149-ba513b774112", "name": "network-vif-deleted", "tag": "a9b46bb0-2f9e-4273-a9ee-899f7e33cdef"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:44:15.454671 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-cd56d02c-eed6-4c09-9fc5-fe8c10cf6c9c req-935f5cc2-7812-4b43-8d95-ac03225e5d8a service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.455142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-cd56d02c-eed6-4c09-9fc5-fe8c10cf6c9c req-935f5cc2-7812-4b43-8d95-ac03225e5d8a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.455570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-cd56d02c-eed6-4c09-9fc5-fe8c10cf6c9c req-935f5cc2-7812-4b43-8d95-ac03225e5d8a service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.467251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-cd56d02c-eed6-4c09-9fc5-fe8c10cf6c9c req-935f5cc2-7812-4b43-8d95-ac03225e5d8a service nova] Creating event network-vif-deleted:a9b46bb0-2f9e-4273-a9ee-899f7e33cdef for instance 74bc34ec-8598-44a8-8149-ba513b774112 on hv-cinder-85220 Sep 01 16:44:15.471986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-cd56d02c-eed6-4c09-9fc5-fe8c10cf6c9c req-935f5cc2-7812-4b43-8d95-ac03225e5d8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Sep 01 16:44:15.472659 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 489/954] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:44:15.525460 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:15.526037 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:15.532459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.532921 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.533351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.534072 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:15.534555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:15.534973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:15.602293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fbb843ada72400e9d9f06521c2a61ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca311e408a714ede8d413375ca68eb67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:44:15.610543 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-91820489-f9c0-477b-8456-e9593aa7d9f6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 200 len: 1299 microversion: 2.1 time: 0.089517 Sep 01 16:44:15.611119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 466/955] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:15 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:44:16.632346 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:44:16.633060 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] [instance: 74bc34ec-8598-44a8-8149-ba513b774112] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:44:16.639222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.639698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.640142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.640915 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:44:16.641370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:44:16.641788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:44:16.655293 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] HTTP exception thrown: Instance 74bc34ec-8598-44a8-8149-ba513b774112 could not be found. Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Request method failure captured: Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 HTTP/1.1 Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOE1HhL5AyjfoRRB9doU4W4517e52B_cjQ0y95noWn1fZDOyCkxObA3eh3vOZfrvBJzwQTY8ove6YLlYNIBIbt0KfBHULaER8YJS9t1b2AWUl4I19GCMCdqoa0XVu9aKajznvsnyzQW1zzMxs-oicBZ2poiVGUMu5HeaBqTUaiyo0Eg Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: ca311e408a714ede8d413375ca68eb67 Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-VolumesActionsTest-1944222307 Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:44:16.656906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ca311e408a714ede8d413375ca68eb67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca311e408a714ede8d413375ca68eb67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ca311e408a714ede8d413375ca68eb67", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ca311e408a714ede8d413375ca68eb67"}]}] Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-VolumesActionsTest-1944222307 Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: ca311e408a714ede8d413375ca68eb67 Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-VolumesActionsTest-1944222307 Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-VolumesActionsTest-1944222307-project Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 3fbb843ada72400e9d9f06521c2a61ab Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-VolumesActionsTest-1944222307-project Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 74bc34ec-8598-44a8-8149-ba513b774112 could not be found. Sep 01 16:44:16.658643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '74bc34ec-8598-44a8-8149-ba513b774112'} Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74bc34ec-8598-44a8-8149-ba513b774112 could not be found. Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:44:16.659642 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bc34ec-8598-44a8-8149-ba513b774112 could not be found. Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bc34ec-8598-44a8-8149-ba513b774112 could not be found. Sep 01 16:44:16.661258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:44:16.662932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] Returning 404 to user: Instance 74bc34ec-8598-44a8-8149-ba513b774112 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:44:16.662932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1973f6ba-4da3-4640-bec8-3a8b10ece9e6 tempest-VolumesActionsTest-1944222307 tempest-VolumesActionsTest-1944222307-project] 10.222.0.58 "GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112" status: 404 len: 111 microversion: 2.1 time: 0.031183 Sep 01 16:44:16.662932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 490/956] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:44:16 2022] GET /compute/v2.1/servers/74bc34ec-8598-44a8-8149-ba513b774112 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:45:11.022029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:11.022615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:11.024611 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:11.025255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:11.031049 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:11.031520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:11.031943 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:11.032617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:11.033061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:11.033474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:11.057661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lazy-loading 'flavor' on Instance uuid 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:45:11.130810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3969f181-c75f-401f-8744-c9129912515c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "POST /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72/action" status: 202 len: 0 microversion: 2.1 time: 0.112732 Sep 01 16:45:11.131383 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 467/957] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:45:11 2022] POST /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:11.139741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:11.140343 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:11.142958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=13 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:11.143735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=36 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:11.148974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:11.149446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:11.149897 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:11.150593 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:11.151048 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:11.151459 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:11.295511 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:11.303287 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5dec6e8d-f688-4b07-ac07-b647f58b9b54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.167443 Sep 01 16:45:11.303854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 491/958] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:11 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:12.327050 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:12.327782 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:12.334279 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:12.334770 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:12.335380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:12.336092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:12.336553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:12.336981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:12.481993 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:12.490014 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-133c77ef-0a00-462a-b861-0eb25c015625 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.168498 Sep 01 16:45:12.490617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 468/959] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:12 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:13.515147 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:13.515910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:13.522977 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:13.523567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:13.524147 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:13.525084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:13.525788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:13.526360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:13.666116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:13.674636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f82ceaf8-02eb-4522-a218-5202e851a6f9 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.163710 Sep 01 16:45:13.675196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 492/960] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:13 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:14.696407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:14.697017 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:14.703481 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:14.704177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:14.704613 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:14.705324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:14.705922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:14.706383 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:14.841488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:14.850567 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9f100031-d151-48ac-88c6-2cdf29b209c8 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.157893 Sep 01 16:45:14.851148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 469/961] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:14 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:15.871792 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:15.872372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:15.874956 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:45:15.875092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:45:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 (ip 10.222.0.58) !!! Sep 01 16:45:15.881106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:15.881580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:15.882003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:15.882736 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:15.883183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:15.883598 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:16.019701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:16.027654 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-995ac681-473c-4901-ab04-a2060650d9c5 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.159814 Sep 01 16:45:16.028712 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 493/962] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:15 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:17.049602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:17.050173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:17.057187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:17.057658 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:17.058086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:17.058792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:17.059245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:17.060356 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:17.194317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:17.202061 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d37aa580-3bfc-4a1c-81a2-eaafcd35c4ac tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.156344 Sep 01 16:45:17.202674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 470/963] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:17 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:18.223513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:18.224041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:18.230934 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:18.231422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:18.231927 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:18.232641 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:18.233834 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:18.234288 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:18.367471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:18.375363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6ee36f3f-e9e0-4cc4-9862-84867704f0da tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.155912 Sep 01 16:45:18.375929 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 494/964] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:18 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:19.397352 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:19.397939 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:19.403920 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:19.404401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:19.404832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:19.405516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:19.406694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:19.407123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:19.536378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:19.544392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0260fd07-d6e4-4a58-ba85-7de0b7ea7f9e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.150972 Sep 01 16:45:19.544964 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 471/965] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:19 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:20.566053 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:20.566679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:20.573059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:20.573541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:20.573974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:20.574706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:20.575207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:20.575639 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:20.707542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:20.715309 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1ee6e3e8-99b2-4997-b728-d10a200d7dca tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.153687 Sep 01 16:45:20.715873 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 495/966] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:20 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:21.737359 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:21.737963 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:21.744912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:21.745386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:21.745817 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:21.746527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:21.746978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:21.747396 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:21.885527 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:21.894361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1a36628c-5e2c-42d0-95bf-6023cdd56fdd tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.160788 Sep 01 16:45:21.894940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 472/967] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:21 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:22.915355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:22.915961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:22.922793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:22.923264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:22.923739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:22.924421 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:22.924964 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:22.925351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:23.058994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:23.067033 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2f595cbb-ce5e-402e-afbc-2d80a1ed41f7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.155435 Sep 01 16:45:23.067629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 496/968] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:22 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:24.088582 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:24.089186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:24.096480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:24.097041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:24.097483 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:24.098183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:24.098737 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:24.099157 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:24.261597 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:24.271064 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d2f58e1e-e01b-4a11-b124-fb80a8634c7f tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.186227 Sep 01 16:45:24.271641 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 473/969] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:24 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:25.296274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:25.296893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:25.303883 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.304378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.304815 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.305520 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.306022 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.306517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.448010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:25.456879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-61e65942-cf3a-4012-8bc7-ef62eb04ce0b tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1509 microversion: 2.1 time: 0.164505 Sep 01 16:45:25.457754 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 497/970] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:25 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:25.477100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:25.477705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:25.484161 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.484574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.485073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.485766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.486246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.486669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.679055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120693) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 16:45:25.757462 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-12fb083c-97a8-4f70-aa2e-3f45ba8235f3 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "POST /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72/action" status: 202 len: 0 microversion: 2.1 time: 0.284074 Sep 01 16:45:25.758137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 474/971] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:45:25 2022] POST /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:45:25.768502 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:25.769118 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:25.776838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.777452 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.777930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.778712 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:25.779121 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:25.779546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:25.980453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:25.989408 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0a520429-7919-4f8d-b1e6-535e95817965 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1517 microversion: 2.1 time: 0.225671 Sep 01 16:45:25.990174 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 498/972] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:25 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1517 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:27.011528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:27.012413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:27.019083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:27.019571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:27.020257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:27.020966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:27.021421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:27.021847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:27.158051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:27.165845 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c14a346b-6419-480a-886a-7341a01bd978 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1519 microversion: 2.1 time: 0.159006 Sep 01 16:45:27.166675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 475/973] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:27 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:27.647698 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-b36d49b5-917c-456d-957b-edc3321f755e req-460b6d76-c86a-4d84-b808-777da837e346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "name": "network-vif-unplugged", "status": "completed", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:27.661049 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b36d49b5-917c-456d-957b-edc3321f755e req-460b6d76-c86a-4d84-b808-777da837e346 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:27.661525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b36d49b5-917c-456d-957b-edc3321f755e req-460b6d76-c86a-4d84-b808-777da837e346 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:27.662128 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b36d49b5-917c-456d-957b-edc3321f755e req-460b6d76-c86a-4d84-b808-777da837e346 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:27.674981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-b36d49b5-917c-456d-957b-edc3321f755e req-460b6d76-c86a-4d84-b808-777da837e346 service nova] Creating event network-vif-unplugged:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:45:27.680837 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-b36d49b5-917c-456d-957b-edc3321f755e req-460b6d76-c86a-4d84-b808-777da837e346 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036347 Sep 01 16:45:27.681671 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 499/974] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:28.187671 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:28.189051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:28.195190 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:28.195673 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:28.196107 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:28.196809 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:28.197261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:28.197683 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:28.332165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:28.340226 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8de2e0a9-935d-4db4-9e8e-a1e56bf12949 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.156426 Sep 01 16:45:28.340787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 476/975] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:28 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:29.361700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:29.362547 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:29.370339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:29.370902 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:29.371404 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:29.372125 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:29.372581 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:29.373008 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:29.519427 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:29.527161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a965b9a9-9b94-48b9-8b43-a0f0deb7a6c7 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.169964 Sep 01 16:45:29.527747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 500/976] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:29 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:30.547828 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:30.548954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:30.555416 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:30.555895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:30.556321 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:30.557006 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:30.557452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:30.557870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:30.698135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:30.707388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4b56f173-9e95-43d2-812a-ff674e26d0d0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.163325 Sep 01 16:45:30.708050 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 477/977] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:30 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:31.729358 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:31.730292 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:31.739357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:31.740078 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:31.740485 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:31.742130 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:31.742809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:31.743264 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:31.887623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:31.897238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-096848c6-4e69-43e7-bfe9-347dd1febc54 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.172275 Sep 01 16:45:31.898457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 501/978] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:31 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:32.918815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:32.919427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:32.926217 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:32.926698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:32.927133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:32.927825 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:32.928280 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:32.928736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:33.071087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:33.078838 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ab0274e5-b4fb-4991-b6c5-be41b8c80256 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.164144 Sep 01 16:45:33.079407 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 478/979] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:32 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:34.100803 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:34.101406 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:34.107942 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.108415 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.108842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.109519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.109971 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.110422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.239793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:34.247542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0dd09a50-f5ac-4db1-bd25-e5de1680a564 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.150582 Sep 01 16:45:34.248101 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 502/980] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:34 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:34.430008 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1015028143", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "networks": [{"uuid": "4f7fdca2-1fd5-477f-be39-6c50f6057c81"}]}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:34.482912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] validate_networks() for [('4f7fdca2-1fd5-477f-be39-6c50f6057c81', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:45:34.836595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:45:34.837076 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:45:34.837544 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:45:34.838077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:45:34.838518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:45:34.847464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.847884 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.848317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.849033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:34.849482 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:34.849902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:34.867096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Getting quotas for project 829ea07fd4c24f87b6eeb96e8a6952a0. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:45:34.871062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Getting quotas for user e8f521436e924bf6a4571d3aeda481cf and project 829ea07fd4c24f87b6eeb96e8a6952a0. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:45:34.882749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:45:34.884985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:45:34.933582 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fc1bb694-1d4d-42a8-bd07-1a55455a8fe3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507345 Sep 01 16:45:34.934253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 479/981] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:45:34.945796 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b56fe93f-3449-4ca4-85a1-bdcb78baffd4 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:34.946537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b56fe93f-3449-4ca4-85a1-bdcb78baffd4 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:34.999669 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b56fe93f-3449-4ca4-85a1-bdcb78baffd4 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:35.007182 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b56fe93f-3449-4ca4-85a1-bdcb78baffd4 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1219 microversion: 2.1 time: 0.065253 Sep 01 16:45:35.007745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 503/982] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:34 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:35.268813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:35.269416 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:35.275498 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.275975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.276401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.277083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:35.277530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:35.277945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:35.411283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:35.419169 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4717e714-14df-4e57-ab95-24d5179f569e tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.154399 Sep 01 16:45:35.419733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 480/983] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:35 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:36.027728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:36.028351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:36.035338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.036099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.036603 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.037620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.038080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.038528 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.102122 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:36.109793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5cdb1abf-ecff-4888-8aab-3250e446fc9c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1271 microversion: 2.1 time: 0.086018 Sep 01 16:45:36.122215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 504/984] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:36 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:36.442560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:36.443153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:36.449606 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.450079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.450550 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.451242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:36.451689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:36.452112 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:36.456539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:36.600966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:36.609036 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b134ad5b-223e-4199-be80-fad2a5b8fb69 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.172015 Sep 01 16:45:36.609608 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 481/985] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:36 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:37.131800 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:37.132570 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:37.139135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.139692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.140196 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.141023 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.141552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.142034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.276582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:37.284366 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2a4a6508-3121-4cc6-9f7a-0ec982eed62b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.156416 Sep 01 16:45:37.285007 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 505/986] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:37 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:37.631699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:37.632421 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:37.640801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.641832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.642555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.643345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.643902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.644394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.743930 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-50be9d75-8f99-460b-81a0-25cbc8235ab5 req-a3fb6644-28d6-488d-b117-c2dc053a323e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1f875d-b781-437b-8ba2-a4f68255c1a3", "tag": "10651c97-2c27-4e1f-b848-8bf4b7d44e85"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:37.761722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-50be9d75-8f99-460b-81a0-25cbc8235ab5 req-a3fb6644-28d6-488d-b117-c2dc053a323e service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:37.763050 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-50be9d75-8f99-460b-81a0-25cbc8235ab5 req-a3fb6644-28d6-488d-b117-c2dc053a323e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:37.763716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-50be9d75-8f99-460b-81a0-25cbc8235ab5 req-a3fb6644-28d6-488d-b117-c2dc053a323e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:37.781035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-50be9d75-8f99-460b-81a0-25cbc8235ab5 req-a3fb6644-28d6-488d-b117-c2dc053a323e service nova] Creating event network-changed:10651c97-2c27-4e1f-b848-8bf4b7d44e85 for instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 on hv-cinder-85220 Sep 01 16:45:37.788997 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-50be9d75-8f99-460b-81a0-25cbc8235ab5 req-a3fb6644-28d6-488d-b117-c2dc053a323e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050046 Sep 01 16:45:37.790138 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 506/987] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:37.800843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:37.808805 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-de55b3ed-ccc2-4644-aa93-1d1e54c85587 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.181422 Sep 01 16:45:37.809381 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 482/988] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:37 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:38.306678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:38.307376 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:38.313566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.314043 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.314575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.315262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.315720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.316148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.451154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.458944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d359b326-d518-4854-a217-b6cc6ec089ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.157111 Sep 01 16:45:38.459772 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 507/989] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:38 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:38.830581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:38.831190 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:38.838147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.838653 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.839085 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.839780 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:38.840224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:38.840650 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:38.972993 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:38.980855 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2aff24a6-e3b9-4b3c-9ba4-aca5b6d8d982 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.154249 Sep 01 16:45:38.981424 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 483/990] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:38 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:39.479367 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:39.479980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:39.486483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.486967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.487474 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.488170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:39.488627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:39.489051 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:39.611937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:39.619793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d6cc2765-7515-4323-a8bb-350b9fa5e29a tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.144298 Sep 01 16:45:39.620369 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 508/991] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:39 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:40.001344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:40.001944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:40.008368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.008850 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.009283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.009976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.010459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.010884 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.143268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-732acb7f-88cf-479e-a92d-8ed8da241835 req-f52cfb06-9420-4c5e-86c8-6d2294910b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "name": "network-vif-plugged", "status": "completed", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:40.153884 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-732acb7f-88cf-479e-a92d-8ed8da241835 req-f52cfb06-9420-4c5e-86c8-6d2294910b33 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.154517 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-732acb7f-88cf-479e-a92d-8ed8da241835 req-f52cfb06-9420-4c5e-86c8-6d2294910b33 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.155044 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-732acb7f-88cf-479e-a92d-8ed8da241835 req-f52cfb06-9420-4c5e-86c8-6d2294910b33 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.168064 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-732acb7f-88cf-479e-a92d-8ed8da241835 req-f52cfb06-9420-4c5e-86c8-6d2294910b33 service nova] Creating event network-vif-plugged:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:45:40.174487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-732acb7f-88cf-479e-a92d-8ed8da241835 req-f52cfb06-9420-4c5e-86c8-6d2294910b33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035129 Sep 01 16:45:40.175594 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 509/992] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:45:40.400615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.408815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-900c6ab5-7421-49b7-83cf-af56247d61d4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.410921 Sep 01 16:45:40.409387 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 484/993] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:39 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:40.642094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:40.643498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:40.650269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.650694 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.651133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.651846 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:40.652300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:40.652720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:40.670441 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=100 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:40.790261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:40.798640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d3448869-ae75-49c8-a448-d1e8bacee7e9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.161347 Sep 01 16:45:40.799778 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 510/994] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:40 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:41.430504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:41.431198 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:41.433600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:41.439425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.452267 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.452747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.453568 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.453962 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.454430 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.632082 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.640913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fb2fe55e-756b-47d8-a60b-911c52ff2be6 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.214301 Sep 01 16:45:41.641851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 485/995] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:41 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:41.820495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:41.821207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:41.823630 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=43 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:41.829155 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.829763 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.830788 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.831489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:41.831943 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:41.832365 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:41.964318 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:41.972041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-94ddfd7f-67cf-488a-99b5-6460f84f2654 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.155520 Sep 01 16:45:41.972611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 511/996] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:41 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:42.662645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.663245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:42.669969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.670454 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.670886 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.671573 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:42.672083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:42.672575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:42.819484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:42.827523 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a4993bee-66ff-4de2-b8b6-1eb51cc72713 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1575 microversion: 2.1 time: 0.169202 Sep 01 16:45:42.828100 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 486/997] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:42 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:42.993700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:42.994344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:43.001285 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.002512 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.003017 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.003963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.004519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.005225 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.140623 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:43.148482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7d2b3133-fcf8-4683-bd66-35cd03b9b47f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.158908 Sep 01 16:45:43.149056 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 512/998] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:42 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:43.850175 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:43.850890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:43.857183 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.857661 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.858148 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:43.858874 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:43.859366 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:43.859833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.125761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:44.136068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d8b3292e-c5d3-48f9-971c-1e73a4b0c5ef tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1562 microversion: 2.1 time: 0.290496 Sep 01 16:45:44.136667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 487/999] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:43 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1562 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:44.169169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:44.169819 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:44.176988 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:44.177471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:44.177909 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.178630 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:44.179084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:44.179501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:44.311011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:44.318613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a749f84c-f53a-4892-bb4d-cdffabd5ba3b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.153615 Sep 01 16:45:44.319209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 513/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:44 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:45.339537 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:45.340150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:45.342549 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:45.343236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:45.354215 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.354699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.355133 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.355887 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:45.356347 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:45.356768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:45.491269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:45.499063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-74b6bb3e-69a3-4dad-a229-313ec8849e42 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.163332 Sep 01 16:45:45.499574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 488/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:45 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:46.206356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-b4be9935-b083-431b-bbbe-48a412630ec8 req-f2346ee5-45d1-41e4-90ca-2c639ca87d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1f875d-b781-437b-8ba2-a4f68255c1a3", "name": "network-vif-plugged", "status": "completed", "tag": "10651c97-2c27-4e1f-b848-8bf4b7d44e85"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:45:46.213412 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:45:46.218467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b4be9935-b083-431b-bbbe-48a412630ec8 req-f2346ee5-45d1-41e4-90ca-2c639ca87d32 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.218932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b4be9935-b083-431b-bbbe-48a412630ec8 req-f2346ee5-45d1-41e4-90ca-2c639ca87d32 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.219354 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b4be9935-b083-431b-bbbe-48a412630ec8 req-f2346ee5-45d1-41e4-90ca-2c639ca87d32 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.231616 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-b4be9935-b083-431b-bbbe-48a412630ec8 req-f2346ee5-45d1-41e4-90ca-2c639ca87d32 service nova] Creating event network-vif-plugged:10651c97-2c27-4e1f-b848-8bf4b7d44e85 for instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 on hv-cinder-85220 Sep 01 16:45:46.237211 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-b4be9935-b083-431b-bbbe-48a412630ec8 req-f2346ee5-45d1-41e4-90ca-2c639ca87d32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037605 Sep 01 16:45:46.237808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 514/1002] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:45:46.520863 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:46.521548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:46.528540 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.529039 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.529476 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.530184 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:46.530704 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:46.531135 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:46.671098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:46.683665 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bf14d4f5-85b2-452b-9f7d-11f1f4cf8a88 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.166800 Sep 01 16:45:46.684250 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 489/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:46 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:47.705835 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:47.707199 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:47.715151 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.715823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.716410 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:47.716960 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:47.717418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:47.717832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:48.068090 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:48.076057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cf3b5927-ec5d-4419-ba95-5a869c722580 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1319 microversion: 2.1 time: 0.374676 Sep 01 16:45:48.076632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 515/1004] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:47 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:45:49.097447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:45:49.098042 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:45:49.104518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.104998 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.105471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.106166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:45:49.106640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:45:49.107057 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:45:49.373954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:45:49.382572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7940be13-850a-43df-9139-1d0c216cee5e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1508 microversion: 2.1 time: 0.289354 Sep 01 16:45:49.384007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 490/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:45:49 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1508 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:06.170730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-939e1ee4-20d5-46b3-b260-293f769aa78a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Action: 'create', calling method: .version_select at 0x7f6c9ccc7af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-98136204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJz2Ve1MLX44vfkwIP5L6PAKVpxaGPj5xd7xdG5JQN/m2RhjPPwUKOPHOr4kGPWnbzB4OTQIeB9cqe+2f1nQpk4arnayxl+a7fItB6g2xCBkD+Asko/RWYPLxmalH1vgHw=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:06.176705 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=9 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:06.177391 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=28 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:06.190936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-939e1ee4-20d5-46b3-b260-293f769aa78a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Getting quotas for project 1f62976899a74162b21efe5580758fd9. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:46:06.195028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-939e1ee4-20d5-46b3-b260-293f769aa78a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Getting quotas for user fac40ee8cdc9495aa1c94f483f6fd6c5 and project 1f62976899a74162b21efe5580758fd9. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:46:06.221736 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-939e1ee4-20d5-46b3-b260-293f769aa78a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.054702 Sep 01 16:46:06.222311 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 516/1006] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:46:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:06.272535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1277334815", "imageRef": "ab385e81-531b-491f-a97b-2e46b37b6b53", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-98136204", "networks": [{"uuid": "18d48648-31ee-4aa0-b61a-96f6e4a8d458"}]}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:06.281835 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=11 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:06.282513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=58 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:06.329380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] validate_networks() for [('18d48648-31ee-4aa0-b61a-96f6e4a8d458', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:46:06.695954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:46:06.696406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:46:06.696881 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:46:06.697287 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:46:06.697693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:46:06.706464 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:06.706940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:06.707376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:06.708094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:06.708545 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:06.708968 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:06.727029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Getting quotas for project 1f62976899a74162b21efe5580758fd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:46:06.733738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Getting quotas for user fac40ee8cdc9495aa1c94f483f6fd6c5 and project 1f62976899a74162b21efe5580758fd9. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:46:06.747600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:46:06.749693 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab385e81-531b-491f-a97b-2e46b37b6b53',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:46:06.795273 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-5b84718d-2f84-421a-8686-86e84f5e5e55 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527241 Sep 01 16:46:06.795836 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 491/1007] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:46:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:46:06.807055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-aef39cab-db57-42e5-a955-20cb79deddb4 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:06.807742 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-aef39cab-db57-42e5-a955-20cb79deddb4 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:06.863575 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-aef39cab-db57-42e5-a955-20cb79deddb4 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:06.870368 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-aef39cab-db57-42e5-a955-20cb79deddb4 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1257 microversion: 2.1 time: 0.067281 Sep 01 16:46:06.870937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 517/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:06 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1257 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:07.891848 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:07.892491 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:07.900413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:07.900895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:07.901332 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:07.902032 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:07.902514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:07.902944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:07.969520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:07.978160 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9db9c6e1-0ba2-4fda-a02b-8a786fbc489b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1309 microversion: 2.1 time: 0.090493 Sep 01 16:46:07.978912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 492/1009] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:07 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:08.999607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:09.001758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:09.009759 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:09.010349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:09.010850 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:09.011640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:09.012161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:09.012653 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:09.159236 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:09.169356 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2730c3a0-7b75-4eb4-b519-3e61585e01fd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.173303 Sep 01 16:46:09.170918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 518/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:08 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:10.192497 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:10.193978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:10.200787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.202170 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.202923 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.204010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:10.204680 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:10.206468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:10.350261 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:10.358427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-505730cd-bbf5-4bea-8e71-b27ba432a689 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.170627 Sep 01 16:46:10.359278 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 493/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:10 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:11.379682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:11.380268 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:11.386866 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:11.387357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:11.387787 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:11.388477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:11.388949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:11.389328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:11.532968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:11.549932 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-45c89a8b-29c7-4748-bcaf-e6b30e50326f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.174556 Sep 01 16:46:11.550663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 519/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:11 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:12.571811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:12.572583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:12.579384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:12.579872 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:12.580315 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:12.581021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:12.581484 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:12.581908 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:12.721738 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:12.729727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0ba56ab9-1042-415b-9a15-721cc8ceb332 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.162335 Sep 01 16:46:12.730520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 494/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:12 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:13.466755 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e08f978-2546-4b4b-a178-7e159655fa9b", "device": "/dev/sdb"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:13.469663 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:13.476795 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:13.477269 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:13.477696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:13.478435 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:13.478889 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:13.479308 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:13.761192 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:13.762649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:13.772063 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:13.772555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:13.772992 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:13.773697 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:13.774158 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:13.774657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:13.914240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:13.925146 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-954cbd13-b964-4660-8540-dafdebfa3eea tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.177280 Sep 01 16:46:13.941221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 495/1014] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:13 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:14.947068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:14.947865 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:14.954366 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:14.954859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:14.955301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:14.956518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:14.957141 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:14.957409 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:15.091675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:15.100342 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-59b82fb8-c883-44e2-a84e-b46495fb0d0e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.157195 Sep 01 16:46:15.100919 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 496/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:14 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:16.120929 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:16.121642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:16.128401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:16.128882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:16.129311 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:16.130005 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:16.130480 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:16.130901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:16.264976 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:16.273665 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8af6c789-66ff-4acf-9f37-b343bf045d22 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.156554 Sep 01 16:46:16.274468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 497/1016] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:16 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:16.868169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:17.293834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:17.294735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:17.296702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:17.297490 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:17.304679 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:17.305168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:17.305604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:17.306337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:17.306801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:17.307222 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:17.442846 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:17.450533 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-960b87eb-5647-4e94-a68a-98dd1b604d7f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.160557 Sep 01 16:46:17.451098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 498/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:17 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:18.470206 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:18.470827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:18.478000 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:18.478514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:18.478949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:18.479639 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:18.480092 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:18.480517 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:18.607470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:18.616043 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4fcbcc69-5cf3-4320-bd68-f70f891a3154 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.149691 Sep 01 16:46:18.616642 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 499/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:18 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:19.637351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:19.638147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:19.646052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:19.646579 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:19.647019 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:19.647715 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:19.648173 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:19.648600 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:19.778053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:19.786406 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3470b8cf-c684-4ca5-b802-07a68ece5301 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.153371 Sep 01 16:46:19.786980 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 500/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:19 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:20.807160 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:20.807797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:20.814150 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:20.814659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:20.815598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:20.816284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:20.816735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:20.817159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:20.941093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:20.949403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-53351116-9506-4738-8a09-f9f95d8123ae tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.146187 Sep 01 16:46:20.949977 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 501/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:20 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:21.969530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:21.970235 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:21.977244 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:21.977727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:21.978172 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:21.978887 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:21.979345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:21.979772 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:22.109068 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:22.116797 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bad9c025-2e4f-46bc-af02-6335a5a46ecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.151153 Sep 01 16:46:22.117373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 502/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:21 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:23.136793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:23.137448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:23.143857 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:23.144855 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:23.145279 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:23.145954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:23.146428 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:23.146844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:23.283488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:23.292599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c2c1eb70-5f0c-413c-80c6-795c0cd15851 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.159487 Sep 01 16:46:23.293193 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 503/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:23 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:46:23.351237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ad0482ec-b04e-47e1-9530-168a0577f8c3 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "POST /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.888276 Sep 01 16:46:23.357004 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 520/1023] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:46:13 2022] POST /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3/os-volume_attachments => generated 194 bytes in 9895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:23.845602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-06b4a0dd-3f2b-4408-8925-0140cf3cff92 req-317cb566-6a07-4c5f-8f8e-9cf6299aebaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:23.855007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-06b4a0dd-3f2b-4408-8925-0140cf3cff92 req-317cb566-6a07-4c5f-8f8e-9cf6299aebaa service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:23.855509 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-06b4a0dd-3f2b-4408-8925-0140cf3cff92 req-317cb566-6a07-4c5f-8f8e-9cf6299aebaa service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:23.855936 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-06b4a0dd-3f2b-4408-8925-0140cf3cff92 req-317cb566-6a07-4c5f-8f8e-9cf6299aebaa service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:23.868499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-06b4a0dd-3f2b-4408-8925-0140cf3cff92 req-317cb566-6a07-4c5f-8f8e-9cf6299aebaa service nova] Creating event network-changed:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:46:23.875966 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-06b4a0dd-3f2b-4408-8925-0140cf3cff92 req-317cb566-6a07-4c5f-8f8e-9cf6299aebaa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033951 Sep 01 16:46:23.876581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 504/1024] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:24.310722 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:24.315070 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:24.315771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:24.322805 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:24.323291 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:24.323726 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:24.324426 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:24.324878 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:24.325300 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:24.470838 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:24.479467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-19c71831-cc90-40b4-9078-6635a8e1d935 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.170099 Sep 01 16:46:24.480057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 521/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:24 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:25.501105 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:25.501814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:25.511258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:25.512314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:25.512850 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:25.513560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:25.514022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:25.514490 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:25.644678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:25.652284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-b2463275-08a0-4807-b1fb-19ac99c183f0 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.155421 Sep 01 16:46:25.652850 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 505/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:25 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:26.673059 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:26.673668 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:26.680198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:26.680681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:26.681117 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:26.681816 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:26.682297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:26.682725 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:26.809777 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:26.818034 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c4eb1766-b4e4-4b05-a70a-67281365eecb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.149073 Sep 01 16:46:26.818702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 522/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:26 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:27.838468 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:27.838994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:27.845575 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:27.846054 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:27.846525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:27.847257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:27.847663 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:27.848090 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:27.976388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:27.983876 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-12349bc2-3c5a-4eaf-baf0-d4a4df513c89 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.149425 Sep 01 16:46:27.984431 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 506/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:27 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:29.004841 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:29.005937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:29.012420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:29.012921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:29.013338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:29.014299 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:29.014758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:29.015181 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:29.144184 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:29.151766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e643cc1d-c755-4dfd-921c-d97b0a5c595c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.150789 Sep 01 16:46:29.152322 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 523/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:28 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:30.172510 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:30.173117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:30.179987 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:30.180472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:30.180909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:30.181593 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:30.182046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:30.182501 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:30.324847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:30.335089 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ca3a82c9-33e1-4164-8813-ddcce4a0c3a6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.166667 Sep 01 16:46:30.335747 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 507/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:30 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:30.420193 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-51fc4c46-0eee-4151-b2c7-cf64bd9c2b31 req-e2698e66-5742-4b45-99cc-13916c733430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "name": "network-vif-plugged", "status": "completed", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:30.430756 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-51fc4c46-0eee-4151-b2c7-cf64bd9c2b31 req-e2698e66-5742-4b45-99cc-13916c733430 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:30.431233 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-51fc4c46-0eee-4151-b2c7-cf64bd9c2b31 req-e2698e66-5742-4b45-99cc-13916c733430 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:30.431781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-51fc4c46-0eee-4151-b2c7-cf64bd9c2b31 req-e2698e66-5742-4b45-99cc-13916c733430 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:30.443820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-51fc4c46-0eee-4151-b2c7-cf64bd9c2b31 req-e2698e66-5742-4b45-99cc-13916c733430 service nova] Creating event network-vif-plugged:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:46:30.448802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-51fc4c46-0eee-4151-b2c7-cf64bd9c2b31 req-e2698e66-5742-4b45-99cc-13916c733430 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032635 Sep 01 16:46:30.449507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 524/1031] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:31.355176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:31.355727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:31.362137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:31.362659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:31.363191 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:31.363891 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:31.364350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:31.365264 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:31.499758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:31.503258 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=100 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:31.509322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-894420b0-85d9-46ba-8f48-0e31fadc7898 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.158099 Sep 01 16:46:31.509894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 508/1032] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:31 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:32.531186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:32.531976 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:32.538120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:32.538658 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:32.539101 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:32.539720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:32.540168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:32.540584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:32.665962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:32.674028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5d467e06-0348-4926-89fe-ee6accfb7edd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.147531 Sep 01 16:46:32.674699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 525/1033] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:32 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:33.695630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:33.696282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:33.702676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:33.703149 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:33.703577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:33.704256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:33.704702 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:33.705121 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:33.839927 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:33.847691 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ba60bb0a-03e9-48ca-ae36-f34395479a42 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.156837 Sep 01 16:46:33.848242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 509/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:33 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:34.868000 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:34.868638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:34.875833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:34.876312 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:34.876746 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:34.877431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:34.877887 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:34.878341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:35.002943 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:35.010508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c2289a70-918d-483b-a33e-aa683a36dff3 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.146305 Sep 01 16:46:35.011067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 526/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:34 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:36.030553 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:36.031165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:36.038101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:36.038621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:36.039056 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:36.039748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:36.040207 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:36.040641 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:36.177698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:36.185542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-4239a407-f0d9-4c87-a183-ba154dcdd676 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1357 microversion: 2.1 time: 0.158834 Sep 01 16:46:36.186110 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 510/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:36 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:37.205999 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:37.206635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:37.213171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.213818 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.214289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.214984 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.215440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.215867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.218537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:37.345858 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:37.353497 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7084b24c-c81e-4bdc-8606-25761ae153e2 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1547 microversion: 2.1 time: 0.151366 Sep 01 16:46:37.354065 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 527/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:37 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:37.373768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:37.374474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:37.376860 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:37.382788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.383276 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.383727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.384408 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.384867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.385293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.514438 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:37.522716 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-db4076d9-bc8b-49c1-984d-2b96b947574e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1547 microversion: 2.1 time: 0.152716 Sep 01 16:46:37.523296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 511/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:37 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:37.542437 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:37.547440 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:37.548219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Searching by: {'deleted': False, 'project_id': '1f62976899a74162b21efe5580758fd9'} {{(pid=120692) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 16:46:37.554918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.555393 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.555825 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.556545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.556993 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.557411 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.654037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.multi_cell_list [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120692) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 16:46:37.746475 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a00f485b-f884-4bc6-b930-4b4fc3178506 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207744 Sep 01 16:46:37.747054 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 528/1039] 10.222.0.58 () {58 vars in 1125 bytes} [Thu Sep 1 16:46:37 2022] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:37.758583 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:37.759188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:37.765086 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.765554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.765983 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.766698 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:37.767147 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:37.767561 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:37.894853 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:37.902434 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1a72ae01-c4bc-4514-85f6-e6b3db56afbb tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1547 microversion: 2.1 time: 0.148199 Sep 01 16:46:37.902995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 512/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:37 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:42.586253 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72d8d11e-ca9d-45c4-bba2-8089662c0e84"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:42.588613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:42.595113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:42.595590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:42.596021 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:42.596706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:42.597150 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:42.597565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:45.918956 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6ba89466-7593-438b-8bf5-a08a6ab02d81 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.336762 Sep 01 16:46:45.919692 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 529/1041] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:46:42 2022] POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments => generated 194 bytes in 3338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:50.146023 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:50.146954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:50.151371 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:50.152475 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=24 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:50.158970 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:50.159984 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:50.160890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:50.161743 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:50.162471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:50.162727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:50.259899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lazy-loading 'services' on Instance uuid cc1f875d-b781-437b-8ba2-a4f68255c1a3 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:46:50.334111 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-68072e3a-1856-43da-aaa4-631aa2b3efe9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3/os-volume_attachments/5e08f978-2546-4b4b-a178-7e159655fa9b" status: 202 len: 0 microversion: 2.1 time: 0.194465 Sep 01 16:46:50.334802 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 513/1042] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:46:50 2022] DELETE /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3/os-volume_attachments/5e08f978-2546-4b4b-a178-7e159655fa9b => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:46:53.507979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:53.509171 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=18 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:46:53.513252 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:53.513939 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:53.521176 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:53.521713 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:53.522243 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:53.522955 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:53.523402 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:53.523822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:53.670108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:53.678648 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-abe8bff4-fc8c-4ed0-82cb-a56e158a80d6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1593 microversion: 2.1 time: 0.172474 Sep 01 16:46:53.679740 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 530/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:53 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:54.677037 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:54.677635 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:54.684748 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:54.685215 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:54.685651 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:54.686378 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:54.686834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:54.687255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:54.714224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:46:54.798329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fd9ef921-1905-4067-8e18-eb0324349321 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 204 len: 0 microversion: 2.1 time: 0.124912 Sep 01 16:46:54.799314 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 514/1044] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:46:54 2022] DELETE /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:46:54.807882 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:54.808584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:54.815139 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:54.815619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:54.816050 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:54.816749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:54.817200 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:54.817618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:54.953393 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:54.961355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-59cab824-745d-41ab-a2fd-1c2614442e1c tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1514 microversion: 2.1 time: 0.157834 Sep 01 16:46:54.961934 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 531/1045] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:54 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:55.388848 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-be3b1a7e-33b0-446f-9741-3275aa17c055 req-fd44ff35-a06b-40f0-9ce0-abcfa5cf9603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:55.400552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-be3b1a7e-33b0-446f-9741-3275aa17c055 req-fd44ff35-a06b-40f0-9ce0-abcfa5cf9603 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:55.401189 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-be3b1a7e-33b0-446f-9741-3275aa17c055 req-fd44ff35-a06b-40f0-9ce0-abcfa5cf9603 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:55.401978 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-be3b1a7e-33b0-446f-9741-3275aa17c055 req-fd44ff35-a06b-40f0-9ce0-abcfa5cf9603 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:55.417713 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-be3b1a7e-33b0-446f-9741-3275aa17c055 req-fd44ff35-a06b-40f0-9ce0-abcfa5cf9603 service nova] Creating event network-changed:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:46:55.422945 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-be3b1a7e-33b0-446f-9741-3275aa17c055 req-fd44ff35-a06b-40f0-9ce0-abcfa5cf9603 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038047 Sep 01 16:46:55.423792 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 515/1046] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:55.988112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:55.989370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:55.993919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:46:55.994297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:46:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 (ip 10.222.0.58) !!! Sep 01 16:46:56.005324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:56.006364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:56.007752 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:56.009262 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:56.010133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:56.010979 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:56.215717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:56.225101 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8c823455-450f-45c0-a764-a82d81b50e9d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1514 microversion: 2.1 time: 0.244823 Sep 01 16:46:56.225732 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 532/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:55 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:56.464829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1155834887"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:56.465624 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:56.476176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:56.477199 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:56.478348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:56.479688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:56.480629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:56.481521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:56.630394 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.network.security_group_api [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Adding security group 3bf1f17d-4109-4d0d-9101-aaf75c81c771 to port ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 Sep 01 16:46:56.959283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f86f91d2-b783-40c6-9926-b767c77e4172 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/action" status: 202 len: 0 microversion: 2.1 time: 0.500167 Sep 01 16:46:56.959960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 516/1048] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:46:56 2022] POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:46:56.968298 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:56.969648 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:56.975972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:56.976643 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:56.977145 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:56.977959 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:56.978506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:56.979016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:57.055648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:46:57.056793 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:46:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Sep 01 16:46:57.153974 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:57.161096 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-d8f1351b-e0dd-42fa-b9c9-33934b81ab6b req-28d2c17f-2d6d-43bc-bb4b-904b0fc23834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:57.175316 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-d8f1351b-e0dd-42fa-b9c9-33934b81ab6b req-28d2c17f-2d6d-43bc-bb4b-904b0fc23834 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:57.176265 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-d8f1351b-e0dd-42fa-b9c9-33934b81ab6b req-28d2c17f-2d6d-43bc-bb4b-904b0fc23834 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:57.177182 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-d8f1351b-e0dd-42fa-b9c9-33934b81ab6b req-28d2c17f-2d6d-43bc-bb4b-904b0fc23834 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:57.178323 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-fc45303e-9de0-4826-86c7-f84c4b7e8a6a tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1640 microversion: 2.1 time: 0.213842 Sep 01 16:46:57.184156 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 533/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:56 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1640 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:57.213419 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-d8f1351b-e0dd-42fa-b9c9-33934b81ab6b req-28d2c17f-2d6d-43bc-bb4b-904b0fc23834 service nova] Creating event network-changed:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:46:57.220344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-d8f1351b-e0dd-42fa-b9c9-33934b81ab6b req-28d2c17f-2d6d-43bc-bb4b-904b0fc23834 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.221290 Sep 01 16:46:57.221542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 517/1050] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:57.259256 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:57.260682 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:57.272400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:57.273851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:57.274566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:57.276172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:57.277207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:57.278395 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:57.695167 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:57.707209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-06930c7d-1e9d-4893-a3af-7799f6d49364 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1514 microversion: 2.1 time: 0.455136 Sep 01 16:46:57.708448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 534/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:57 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1514 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:58.731766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:58.732470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:58.739283 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:58.739768 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:58.740223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:58.740952 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:58.741417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:58.742471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:58.776982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:58.777474 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:58.777912 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:58.778398 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lazy-loading 'fault' on Instance uuid cc1f875d-b781-437b-8ba2-a4f68255c1a3 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:46:58.822798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:46:58.830787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fad4fff3-66df-4bbe-88e1-f2058b87da6f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 200 len: 1309 microversion: 2.1 time: 0.103315 Sep 01 16:46:58.831587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 518/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:58 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:46:59.247766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-0c630b46-b0fe-47fd-aee5-fdf9598107ec req-2cea2190-2b49-491c-a7de-4e3bac1465a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1f875d-b781-437b-8ba2-a4f68255c1a3", "name": "network-vif-deleted", "tag": "10651c97-2c27-4e1f-b848-8bf4b7d44e85"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:46:59.257645 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-0c630b46-b0fe-47fd-aee5-fdf9598107ec req-2cea2190-2b49-491c-a7de-4e3bac1465a3 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:59.258116 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-0c630b46-b0fe-47fd-aee5-fdf9598107ec req-2cea2190-2b49-491c-a7de-4e3bac1465a3 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:59.258565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-0c630b46-b0fe-47fd-aee5-fdf9598107ec req-2cea2190-2b49-491c-a7de-4e3bac1465a3 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:59.268977 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-0c630b46-b0fe-47fd-aee5-fdf9598107ec req-2cea2190-2b49-491c-a7de-4e3bac1465a3 service nova] Creating event network-vif-deleted:10651c97-2c27-4e1f-b848-8bf4b7d44e85 for instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 on hv-cinder-85220 Sep 01 16:46:59.274501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-0c630b46-b0fe-47fd-aee5-fdf9598107ec req-2cea2190-2b49-491c-a7de-4e3bac1465a3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Sep 01 16:46:59.275094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 535/1053] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:46:59.853274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:46:59.853995 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: cc1f875d-b781-437b-8ba2-a4f68255c1a3] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:46:59.861551 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:59.862040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:59.862526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:59.863268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:46:59.863749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:46:59.864188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:46:59.878955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] HTTP exception thrown: Instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 could not be found. Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Request method failure captured: Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 HTTP/1.1 Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOGr-FHxDfZI59fwdJ1w-59HS4sKCO82hzemYxEgoUG5Uh3YBUBARRiPofXwTVKjTbxJTjC0IO3Ty1blS7f98aQbwucjq1rF25l3nQiOdDfatrDRo-uHHyvJX8hoZYwD2pVcA2d6PH5UJZIxQSCxuMj_DUJKduEk0On3SXSmxzkgPYU Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 829ea07fd4c24f87b6eeb96e8a6952a0 Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesSnapshotTestJSON-149149040 Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:46:59.880774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/829ea07fd4c24f87b6eeb96e8a6952a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/829ea07fd4c24f87b6eeb96e8a6952a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_829ea07fd4c24f87b6eeb96e8a6952a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/829ea07fd4c24f87b6eeb96e8a6952a0"}]}] Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesSnapshotTestJSON-149149040 Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 829ea07fd4c24f87b6eeb96e8a6952a0 Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-149149040 Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesSnapshotTestJSON-149149040-project Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: e8f521436e924bf6a4571d3aeda481cf Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesSnapshotTestJSON-149149040-project Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 could not be found. Sep 01 16:46:59.882626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'cc1f875d-b781-437b-8ba2-a4f68255c1a3'} Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 could not be found. Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:46:59.883644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 could not be found. Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 could not be found. Sep 01 16:46:59.885292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:46:59.886764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Returning 404 to user: Instance cc1f875d-b781-437b-8ba2-a4f68255c1a3 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:46:59.886764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a05a3bd4-91c9-467f-8c03-bb84f4919376 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3" status: 404 len: 111 microversion: 2.1 time: 0.033680 Sep 01 16:46:59.886764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 519/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:46:59 2022] GET /compute/v2.1/servers/cc1f875d-b781-437b-8ba2-a4f68255c1a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:47:12.026673 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=12 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.027420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.031820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1825775239", "imageRef": "131e8fa4-8f38-499e-9b83-33262175c90e", "flavorRef": "452", "networks": [{"uuid": "4f7fdca2-1fd5-477f-be39-6c50f6057c81"}]}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:12.090336 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] validate_networks() for [('4f7fdca2-1fd5-477f-be39-6c50f6057c81', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:47:12.432898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:47:12.433321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:47:12.433784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:47:12.434185 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:47:12.434647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:47:12.443540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:12.444009 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:12.444434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:12.445681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:12.446129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:12.446573 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:12.464132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Getting quotas for project 829ea07fd4c24f87b6eeb96e8a6952a0. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:47:12.468151 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Getting quotas for user e8f521436e924bf6a4571d3aeda481cf and project 829ea07fd4c24f87b6eeb96e8a6952a0. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:47:12.479340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:47:12.481735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='131e8fa4-8f38-499e-9b83-33262175c90e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:47:12.530683 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6a530917-890d-4d7e-becb-721ad2fdb99b tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505462 Sep 01 16:47:12.531335 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 536/1055] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:47:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:47:12.542210 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-74e25e07-c9f6-4c73-924e-8bf7238efdbc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:12.542829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-74e25e07-c9f6-4c73-924e-8bf7238efdbc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:12.545420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.547677 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:12.606242 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-74e25e07-c9f6-4c73-924e-8bf7238efdbc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:12.613907 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-74e25e07-c9f6-4c73-924e-8bf7238efdbc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1219 microversion: 2.1 time: 0.075814 Sep 01 16:47:12.614547 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 520/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:12 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:13.635360 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:13.635898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:13.645256 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:13.645802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:13.646258 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:13.646973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:13.647427 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:13.648640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:13.728892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:13.738829 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-efc2a24b-c8cd-4e57-a093-0e210f0aecd9 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1279 microversion: 2.1 time: 0.107944 Sep 01 16:47:13.739665 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 537/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:13 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1279 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:14.760794 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:14.761404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:14.769021 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:14.769513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:14.769946 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:14.770685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:14.771144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:14.771571 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:14.904243 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:14.912178 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2ee30113-38da-4a51-90a2-df5ca5a095b6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.155798 Sep 01 16:47:14.912762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 521/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:14 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:15.249168 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-13344b12-8768-4d82-8c20-46187f358494 req-c7def2d7-1115-4081-9e3b-13be19b85cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e529785a-f85f-42c0-a2d1-2adbefe478db", "tag": "7905b000-f8ac-473f-8fa0-28f88363fba7"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:15.259557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-13344b12-8768-4d82-8c20-46187f358494 req-c7def2d7-1115-4081-9e3b-13be19b85cda service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.260089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-13344b12-8768-4d82-8c20-46187f358494 req-c7def2d7-1115-4081-9e3b-13be19b85cda service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.260597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-13344b12-8768-4d82-8c20-46187f358494 req-c7def2d7-1115-4081-9e3b-13be19b85cda service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:15.272190 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-13344b12-8768-4d82-8c20-46187f358494 req-c7def2d7-1115-4081-9e3b-13be19b85cda service nova] Creating event network-changed:7905b000-f8ac-473f-8fa0-28f88363fba7 for instance e529785a-f85f-42c0-a2d1-2adbefe478db on hv-cinder-85220 Sep 01 16:47:15.277351 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-13344b12-8768-4d82-8c20-46187f358494 req-c7def2d7-1115-4081-9e3b-13be19b85cda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031921 Sep 01 16:47:15.277962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 538/1059] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:15.933284 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:15.933826 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:15.940329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.940813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.941348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:15.942045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:15.942565 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:15.942994 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:16.073207 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:16.080922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9c5dedb5-c23b-47bc-817b-06b61c37bb9f tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.151885 Sep 01 16:47:16.081503 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 522/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:15 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:17.103563 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:17.104280 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:17.110552 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:17.111032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:17.111470 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:17.112154 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:17.112607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:17.113028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:17.244048 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:17.251894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c9edf70d-5a20-4c63-adce-1979d10a8c27 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.153655 Sep 01 16:47:17.252465 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 539/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:17 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:18.273079 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:18.273904 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:18.280675 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:18.281159 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:18.281617 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:18.282520 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:18.283015 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:18.283482 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:18.438833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:18.446935 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1e5a2160-4502-4600-88e4-fb7c5099cbdc tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.178226 Sep 01 16:47:18.447526 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 523/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:18 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:19.468449 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:19.469084 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:19.476006 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.476489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.476969 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.478207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:19.478660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:19.479081 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:19.610781 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:19.618400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2a0516d2-66c3-4237-b8ef-a288b40f0694 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.153962 Sep 01 16:47:19.619003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 540/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:19 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:20.640131 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:20.640767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:20.647228 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.647700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.648130 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.648843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:20.649290 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:20.649705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:20.781127 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:20.789031 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-19b2c04f-cc85-4c4a-903a-350f8508bc6e tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.152744 Sep 01 16:47:20.790176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 524/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:20 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:21.810724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:21.811301 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:21.818247 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:21.818747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:21.819185 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:21.819892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:21.820348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:21.821341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:21.963696 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:21.971664 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3f63752f-a71b-481d-b20e-3b6d2dec3197 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.164975 Sep 01 16:47:21.972253 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 541/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:21 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:22.960706 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-0536b2bc-651d-4641-9d5c-34e40a6bb3ee req-4583ebf6-b888-4bfa-8df3-4acb8919ec0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e529785a-f85f-42c0-a2d1-2adbefe478db", "name": "network-vif-plugged", "status": "completed", "tag": "7905b000-f8ac-473f-8fa0-28f88363fba7"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:22.966909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:22.972909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-0536b2bc-651d-4641-9d5c-34e40a6bb3ee req-4583ebf6-b888-4bfa-8df3-4acb8919ec0d service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:22.973388 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-0536b2bc-651d-4641-9d5c-34e40a6bb3ee req-4583ebf6-b888-4bfa-8df3-4acb8919ec0d service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:22.973812 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-0536b2bc-651d-4641-9d5c-34e40a6bb3ee req-4583ebf6-b888-4bfa-8df3-4acb8919ec0d service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:22.985548 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-0536b2bc-651d-4641-9d5c-34e40a6bb3ee req-4583ebf6-b888-4bfa-8df3-4acb8919ec0d service nova] Creating event network-vif-plugged:7905b000-f8ac-473f-8fa0-28f88363fba7 for instance e529785a-f85f-42c0-a2d1-2adbefe478db on hv-cinder-85220 Sep 01 16:47:22.990842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-0536b2bc-651d-4641-9d5c-34e40a6bb3ee req-4583ebf6-b888-4bfa-8df3-4acb8919ec0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034036 Sep 01 16:47:22.991761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 525/1066] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:22.993700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:22.994583 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:22.996422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:22.997088 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:23.004058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:23.004625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:23.004978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:23.005723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:23.006134 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:23.006584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:23.144840 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:23.152566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c69e1af5-1212-49f5-9fc9-16786e11a8e2 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.163558 Sep 01 16:47:23.153142 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 542/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:22 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:24.174590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:24.175293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:24.181616 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:24.182098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:24.182564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:24.183259 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:24.183720 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:24.184145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:24.328587 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:24.337073 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ebce9a98-7253-40da-b25a-4f4db27c7fdd tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.166810 Sep 01 16:47:24.337648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 526/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:24 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:25.358910 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:25.359511 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:25.365844 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:25.366364 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:25.366799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:25.367550 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:25.368035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:25.368460 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:25.503429 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:25.511874 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9ea4f8c8-7015-4b8a-827d-94bb40c1b410 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1319 microversion: 2.1 time: 0.157477 Sep 01 16:47:25.517761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 543/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:25 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:26.533308 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:26.533909 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:26.540999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:26.541475 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:26.541908 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:26.542687 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:26.543142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:26.543563 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:26.683364 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:26.691067 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f8be316b-c61b-444f-8ac9-bb2694e238ad tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1507 microversion: 2.1 time: 0.161927 Sep 01 16:47:26.691638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 527/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:26 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:26.712148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbcdcf6c-6cbc-4b81-8535-fb4147c117f5", "device": "/dev/sdb"}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:26.714660 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:26.721083 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:26.721568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:26.722001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:26.722725 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:26.723183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:26.723605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:26.984024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e397833a-cd52-48ad-850d-91b17f974bfe tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "POST /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276361 Sep 01 16:47:26.984842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 544/1071] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Sep 1 16:47:26 2022] POST /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:47.512560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:47.513606 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:47.519760 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=18 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:47.520851 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-ede016f0-c0ce-48fb-b673-75392150636d req-e76ddd78-b51f-4c45-a16a-eed885b856e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:47.521574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=38 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:47.528488 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:47.529948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:47.530670 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:47.532167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:47.532992 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:47.533399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:47.534100 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:47:47.536041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:47.537501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-ede016f0-c0ce-48fb-b673-75392150636d req-e76ddd78-b51f-4c45-a16a-eed885b856e5 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:47.538093 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-ede016f0-c0ce-48fb-b673-75392150636d req-e76ddd78-b51f-4c45-a16a-eed885b856e5 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:47.538737 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-ede016f0-c0ce-48fb-b673-75392150636d req-e76ddd78-b51f-4c45-a16a-eed885b856e5 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:47.559494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-ede016f0-c0ce-48fb-b673-75392150636d req-e76ddd78-b51f-4c45-a16a-eed885b856e5 service nova] Creating event network-changed:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:47:47.568771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-ede016f0-c0ce-48fb-b673-75392150636d req-e76ddd78-b51f-4c45-a16a-eed885b856e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061505 Sep 01 16:47:47.573681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 545/1072] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:47.592875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:47:47.746618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ba0b41ba-f2da-4ea0-a31b-0520b8348e9a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "DELETE /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 204 len: 0 microversion: 2.1 time: 0.242603 Sep 01 16:47:47.753052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 528/1073] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:47:47 2022] DELETE /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:47:47.765918 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:47.768359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:47.779379 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:47.779950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:47.780480 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:47.781399 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:47.781929 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:47.782448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:47.971495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:47.982955 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-567c53b7-71d1-4de9-9f55-872f79fc4b9c tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.227328 Sep 01 16:47:47.983551 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 546/1074] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:47 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:48.745221 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:48.746166 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:48.754663 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:48.755260 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:48.755847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:48.757026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:48.757733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:48.758414 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:48.844012 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lazy-loading 'services' on Instance uuid e529785a-f85f-42c0-a2d1-2adbefe478db {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:47:48.917329 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7832edfa-04d4-4600-aa9c-b133e7d629d6 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db/os-volume_attachments/bbcdcf6c-6cbc-4b81-8535-fb4147c117f5" status: 202 len: 0 microversion: 2.1 time: 0.178811 Sep 01 16:47:48.917924 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 529/1075] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:47:48 2022] DELETE /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db/os-volume_attachments/bbcdcf6c-6cbc-4b81-8535-fb4147c117f5 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:47:49.009540 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:49.011032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:49.021885 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:49.023232 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:49.023793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:49.025717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:49.026355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:49.026839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:49.179167 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:49.187913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b9739d37-dd6f-4149-ba63-b29de778e1a0 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1568 microversion: 2.1 time: 0.183895 Sep 01 16:47:49.188513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 547/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:49 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:50.210796 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:50.211609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:50.218305 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:50.218888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:50.219631 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:50.220293 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:50.220727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:50.221219 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:50.371143 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:50.379997 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8840b460-453c-4a0f-9249-6dea391763df tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1450 microversion: 2.1 time: 0.174455 Sep 01 16:47:50.380577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 530/1077] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:50 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:50.719617 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-04ac6ebb-dfe3-4941-9932-52f144897415 req-6ce0c924-2a15-4193-ac68-cd3cb4f95129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ce4441-3cb9-4ff7-a4d6-04b5d7184f72", "name": "network-vif-deleted", "tag": "51d9981c-998d-4911-8909-39ca11e3042c"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:50.733089 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-04ac6ebb-dfe3-4941-9932-52f144897415 req-6ce0c924-2a15-4193-ac68-cd3cb4f95129 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:50.733636 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-04ac6ebb-dfe3-4941-9932-52f144897415 req-6ce0c924-2a15-4193-ac68-cd3cb4f95129 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:50.734099 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-04ac6ebb-dfe3-4941-9932-52f144897415 req-6ce0c924-2a15-4193-ac68-cd3cb4f95129 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:50.748619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-04ac6ebb-dfe3-4941-9932-52f144897415 req-6ce0c924-2a15-4193-ac68-cd3cb4f95129 service nova] Creating event network-vif-deleted:51d9981c-998d-4911-8909-39ca11e3042c for instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 on hv-cinder-85220 Sep 01 16:47:50.756016 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-04ac6ebb-dfe3-4941-9932-52f144897415 req-6ce0c924-2a15-4193-ac68-cd3cb4f95129 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040370 Sep 01 16:47:50.756688 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 548/1078] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:51.132569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:51.133943 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:51.141953 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.142556 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.143038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.143875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.144776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.145463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.196493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:47:51.288204 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a628e5b5-b089-49df-be51-30fd1a211773 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 204 len: 0 microversion: 2.1 time: 0.161767 Sep 01 16:47:51.288949 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 531/1079] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:47:51 2022] DELETE /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:47:51.298183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:51.299067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:51.306147 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.306678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.307113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.307973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.308448 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.308938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.403461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:51.404168 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:51.410450 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.411033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.411469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.412186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.412640 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.413065 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.448534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:51.449005 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:51.449437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:51.449878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lazy-loading 'fault' on Instance uuid 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:47:51.455524 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:51.464198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-01bd9b4f-015a-434b-9141-19e8cbb2138d tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1513 microversion: 2.1 time: 0.170445 Sep 01 16:47:51.464784 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 549/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:51 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:51.499282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:51.507203 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0b176ebb-30a4-4a2d-955a-05e2fddcf16a tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1225 microversion: 2.1 time: 0.108462 Sep 01 16:47:51.507780 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 532/1081] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:51 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:52.485102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:52.485704 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:52.492289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:52.492761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:52.493188 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:52.493868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:52.494349 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:52.494766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:52.536199 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:52.537544 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:52.544360 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:52.544842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:52.545277 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:52.546030 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:52.546461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:52.546883 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:52.581522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:52.582062 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:52.582528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:52.582975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lazy-loading 'fault' on Instance uuid 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:47:52.635187 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b60450d50b4fbaa9a85dd39643e403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bde90cf98c1140f298e9cc8db9c8932f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:52.643456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-036b58e9-d871-4fc4-b09e-29d8fc177cff tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 200 len: 1225 microversion: 2.1 time: 0.113096 Sep 01 16:47:52.643959 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 533/1082] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:52 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 1225 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:47:52.666855 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:52.675848 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-27a7f020-27e0-49d2-b339-8f8e46dc46a0 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1513 microversion: 2.1 time: 0.194519 Sep 01 16:47:52.676484 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 550/1083] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:52 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1513 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:53.664269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:53.665041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] [instance: 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:53.671913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:53.672400 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:53.673129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:53.673832 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:53.674326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:53.674756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:53.692774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] HTTP exception thrown: Instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 could not be found. Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Request method failure captured: Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 HTTP/1.1 Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOCY7GXwzAXPuN5tiWCpxmfxPsG0htwFDcrufVkFusKVnosMG6xYlli5_IjPE0Jutgwi44zr8BFfZbBqBq8hCySXZfQPvhbxJAbUhdrTMc1OhCXt-995fKD0G5DkTuuD_3-y5uOn2ggvrC2LfTHLZIGTJqKpQuXz8K7b4XZmvuF-8Uk Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: bde90cf98c1140f298e9cc8db9c8932f Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-TestShelveInstance-1521392956 Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:47:53.694496 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bde90cf98c1140f298e9cc8db9c8932f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bde90cf98c1140f298e9cc8db9c8932f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bde90cf98c1140f298e9cc8db9c8932f", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bde90cf98c1140f298e9cc8db9c8932f"}]}] Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-TestShelveInstance-1521392956 Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: bde90cf98c1140f298e9cc8db9c8932f Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-TestShelveInstance-1521392956 Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-TestShelveInstance-1521392956-project Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: d0b60450d50b4fbaa9a85dd39643e403 Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-TestShelveInstance-1521392956-project Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 could not be found. Sep 01 16:47:53.696816 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '01ce4441-3cb9-4ff7-a4d6-04b5d7184f72'} Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 could not be found. Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:47:53.698102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 could not be found. Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 could not be found. Sep 01 16:47:53.702868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:53.704324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Returning 404 to user: Instance 01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:47:53.704324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7f370b1e-ddf8-48e9-bb0d-e0f8aeda7fd4 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72" status: 404 len: 111 microversion: 2.1 time: 0.037435 Sep 01 16:47:53.704324 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 534/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:53 2022] GET /compute/v2.1/servers/01ce4441-3cb9-4ff7-a4d6-04b5d7184f72 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:47:53.704765 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:53.704765 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:53.710314 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:53.710804 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:53.711279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:53.712003 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:53.712509 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:53.712931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:53.851261 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f521436e924bf6a4571d3aeda481cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '829ea07fd4c24f87b6eeb96e8a6952a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:47:53.860245 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-0fd7fd6d-bedb-499a-9860-1f54fae6f9a5 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 200 len: 1513 microversion: 2.1 time: 0.164494 Sep 01 16:47:53.860824 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 551/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:53 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:47:53.999029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c4d89b8b-a599-4ee4-a26f-64cdf1209e19 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] Calling method '.version_select at 0x7f6c9db1f430>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:54.027246 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c4d89b8b-a599-4ee4-a26f-64cdf1209e19 tempest-TestShelveInstance-1521392956 tempest-TestShelveInstance-1521392956-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1970582924" status: 202 len: 0 microversion: 2.1 time: 0.032060 Sep 01 16:47:54.028380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 535/1086] 10.222.0.58 () {58 vars in 1254 bytes} [Thu Sep 1 16:47:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1970582924 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:47:54.122952 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-28800ab6-51fe-4926-a89f-e2b312c2ec05 req-49eeb19f-776e-48d4-97bb-f797db9d48b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e529785a-f85f-42c0-a2d1-2adbefe478db", "name": "network-vif-deleted", "tag": "7905b000-f8ac-473f-8fa0-28f88363fba7"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:47:54.133701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-28800ab6-51fe-4926-a89f-e2b312c2ec05 req-49eeb19f-776e-48d4-97bb-f797db9d48b1 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:54.134180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-28800ab6-51fe-4926-a89f-e2b312c2ec05 req-49eeb19f-776e-48d4-97bb-f797db9d48b1 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:54.134679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-28800ab6-51fe-4926-a89f-e2b312c2ec05 req-49eeb19f-776e-48d4-97bb-f797db9d48b1 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:54.146678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-28800ab6-51fe-4926-a89f-e2b312c2ec05 req-49eeb19f-776e-48d4-97bb-f797db9d48b1 service nova] Creating event network-vif-deleted:7905b000-f8ac-473f-8fa0-28f88363fba7 for instance e529785a-f85f-42c0-a2d1-2adbefe478db on hv-cinder-85220 Sep 01 16:47:54.153332 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-28800ab6-51fe-4926-a89f-e2b312c2ec05 req-49eeb19f-776e-48d4-97bb-f797db9d48b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Sep 01 16:47:54.153924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 552/1087] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:47:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:47:54.885399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:47:54.886311 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] [instance: e529785a-f85f-42c0-a2d1-2adbefe478db] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:47:54.894764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:54.895254 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:54.895764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:54.896469 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:47:54.896917 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:47:54.897337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:47:54.912256 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] HTTP exception thrown: Instance e529785a-f85f-42c0-a2d1-2adbefe478db could not be found. Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Request method failure captured: Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db HTTP/1.1 Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOGr-FHxDfZI59fwdJ1w-59HS4sKCO82hzemYxEgoUG5Uh3YBUBARRiPofXwTVKjTbxJTjC0IO3Ty1blS7f98aQbwucjq1rF25l3nQiOdDfatrDRo-uHHyvJX8hoZYwD2pVcA2d6PH5UJZIxQSCxuMj_DUJKduEk0On3SXSmxzkgPYU Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 829ea07fd4c24f87b6eeb96e8a6952a0 Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-VolumesSnapshotTestJSON-149149040 Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:47:54.913893 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/829ea07fd4c24f87b6eeb96e8a6952a0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/829ea07fd4c24f87b6eeb96e8a6952a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_829ea07fd4c24f87b6eeb96e8a6952a0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/829ea07fd4c24f87b6eeb96e8a6952a0"}]}] Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-VolumesSnapshotTestJSON-149149040 Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 829ea07fd4c24f87b6eeb96e8a6952a0 Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-149149040 Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-VolumesSnapshotTestJSON-149149040-project Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: e8f521436e924bf6a4571d3aeda481cf Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-VolumesSnapshotTestJSON-149149040-project Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance e529785a-f85f-42c0-a2d1-2adbefe478db could not be found. Sep 01 16:47:54.915727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': 'e529785a-f85f-42c0-a2d1-2adbefe478db'} Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e529785a-f85f-42c0-a2d1-2adbefe478db could not be found. Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:47:54.916581 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e529785a-f85f-42c0-a2d1-2adbefe478db could not be found. Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e529785a-f85f-42c0-a2d1-2adbefe478db could not be found. Sep 01 16:47:54.917890 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:47:54.919177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] Returning 404 to user: Instance e529785a-f85f-42c0-a2d1-2adbefe478db could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:47:54.919177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7b24f7b7-3659-45f3-ba5c-4558b72bc553 tempest-VolumesSnapshotTestJSON-149149040 tempest-VolumesSnapshotTestJSON-149149040-project] 10.222.0.58 "GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db" status: 404 len: 111 microversion: 2.1 time: 0.036362 Sep 01 16:47:54.919177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 536/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:47:54 2022] GET /compute/v2.1/servers/e529785a-f85f-42c0-a2d1-2adbefe478db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:48:13.693500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=16 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:13.694281 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=36 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:13.879162 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-34abc5e4-776e-4373-a524-2aae4daedc8c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Action: 'create', calling method: .version_select at 0x7f6c9cdcc8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-442711278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUTP8rXcLjb+w0WxK9RA4uOz8/oo/fkq82NSok6wi64wQmywjfTbyhHOzugbgEN8IogWjHjGiAtvPtsu2MK1cdy2mjZbOPKCr1aN5M7hlDall7hnWx6DP5uaR6XlHS9NQ=="}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:13.895190 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-34abc5e4-776e-4373-a524-2aae4daedc8c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for project 20a271a8da6d423db38d5730006af839. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:48:13.900289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-34abc5e4-776e-4373-a524-2aae4daedc8c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for user 8fa0f309a0b749b1a782d489f1f352af and project 20a271a8da6d423db38d5730006af839. Resources: {'key_pairs'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:48:13.926625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-34abc5e4-776e-4373-a524-2aae4daedc8c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.234541 Sep 01 16:48:13.927229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 553/1089] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Sep 1 16:48:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:48:35.484233 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:35.486492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:35.489248 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:35.489914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:35.496417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:35.496898 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:35.497333 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:35.498035 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:35.498588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:35.498999 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:35.577186 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bd4fed64-e180-4d89-b019-2148b2acd447 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/action" status: 202 len: 0 microversion: 2.1 time: 0.096184 Sep 01 16:48:35.580885 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 537/1090] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:48:35 2022] POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:48:35.587198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:35.588024 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:35.590891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=4 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:35.592096 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:35.602086 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:35.602687 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:35.603133 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:35.603839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:35.604331 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:35.604797 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:35.751870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:35.760755 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-325759aa-be88-4578-a19a-3e1dc93b7e2b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1751 microversion: 2.1 time: 0.178491 Sep 01 16:48:35.761418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 554/1091] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:35 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:36.783697 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:36.784397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:36.790682 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.791102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.791534 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.792218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:36.792669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:36.793091 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:36.961145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:36.969447 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-07141581-1a7c-41e9-9734-0331f4784e8c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.190614 Sep 01 16:48:36.970022 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 538/1092] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:36 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:37.991369 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:37.992626 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:38.000191 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:38.000678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:38.001112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:38.001812 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:38.002297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:38.002724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:38.152148 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:38.160362 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d098ae56-a794-4b38-91e2-7990fa88407f tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.173027 Sep 01 16:48:38.160937 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 555/1093] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:37 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:39.182759 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:39.183368 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:39.185643 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:48:39.185785 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f (ip 10.222.0.58) !!! Sep 01 16:48:39.194729 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:39.195699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:39.196129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:39.196821 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:39.197271 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:39.197721 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:39.343224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:39.351713 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-6e27b12d-ac83-44c6-8ba2-332019c03ca1 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.172947 Sep 01 16:48:39.352289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 539/1094] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:39 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:39.934135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-982919152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-442711278", "security_groups": [{"name": "tempest-secgroup-smoke-163787977"}], "block_device_mapping_v2": [{"uuid": "f69f019a-e86a-43f2-a9a3-b67b6f88bae1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63275c53-398b-4204-8b5c-6e1c3ef9f8ff"}]}} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:40.046157 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.network.neutron [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] validate_networks() for [('63275c53-398b-4204-8b5c-6e1c3ef9f8ff', None, None, None, None, None)] {{(pid=120692) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:48:40.372922 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:40.373625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:40.381049 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:40.381622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:40.382127 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:40.383087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:40.384322 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:40.384889 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:40.646227 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:40.657117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8a47abf7-7aa4-4dd5-a436-6de528ab5819 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.287621 Sep 01 16:48:40.657771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 540/1095] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:40 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:40.658723 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Flavor limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:48:40.659219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Image limits 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:48:40.659700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Flavor pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:48:40.660112 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Image pref 0:0:0 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:48:40.660539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.virt.hardware [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120692) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:48:40.671545 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:40.672334 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:40.672766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:40.673828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:40.674389 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:40.674813 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:40.692424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for project 20a271a8da6d423db38d5730006af839. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:48:40.696340 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.quota [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for user 8fa0f309a0b749b1a782d489f1f352af and project 20a271a8da6d423db38d5730006af839. Resources: {'instances', 'cores', 'ram'} {{(pid=120692) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:48:40.755679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Going to run 1 instances... {{(pid=120692) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:48:40.758396 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f69f019a-e86a-43f2-a9a3-b67b6f88bae1',volume_size=None,volume_type=None)] {{(pid=120692) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:48:40.891768 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-6dfd1a6b-036d-4659-b618-94ed86cfd825 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.961393 Sep 01 16:48:40.892429 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 556/1096] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:48:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:48:40.903868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-fd122e9d-8845-4290-8322-c22e591fdaf2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:40.904475 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-fd122e9d-8845-4290-8322-c22e591fdaf2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:40.959422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-fd122e9d-8845-4290-8322-c22e591fdaf2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:40.968211 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-fd122e9d-8845-4290-8322-c22e591fdaf2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1093 microversion: 2.1 time: 0.068621 Sep 01 16:48:40.968930 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 541/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:40 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:41.681924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:41.682793 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:41.689010 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:41.689494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:41.689928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:41.690656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:41.691108 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:41.691533 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:41.840427 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:41.848711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8860d263-b827-46a6-919f-d4e1b1fb4b62 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.172497 Sep 01 16:48:41.849279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 557/1098] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:41 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:41.988895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:41.989528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:41.997011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:41.997486 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:41.997914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:41.998641 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:41.999088 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:41.999507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:42.062185 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:42.070801 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0c5b8bb5-9aa4-44a3-9564-05051316ad1e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1191 microversion: 2.1 time: 0.085136 Sep 01 16:48:42.071377 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 542/1099] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:41 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:42.872715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:42.873170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:42.885510 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:42.886317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:42.886934 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:42.887809 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:42.888498 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:42.888986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:43.078711 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:43.092269 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:43.092904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4d4c4023-7107-43db-a4f0-df1abe6af60c tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.225552 Sep 01 16:48:43.093007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:43.093534 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 558/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:42 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:43.107921 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:43.108732 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:43.109337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:43.110339 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:43.110863 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:43.112671 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:43.252415 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:43.261629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-23b34ad1-00b9-4fc6-b664-8646a6cd6350 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.173119 Sep 01 16:48:43.262467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 543/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:43 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:43.755420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-b39faca1-adb5-4690-a284-257978ea19d5 req-3f45055a-76f0-4137-9e9a-07c16891fd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905d7b51-28e3-45cb-b5cc-194f938b63a0", "tag": "6d27c2f1-1b30-4813-81d5-157b172a995b"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:43.766597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b39faca1-adb5-4690-a284-257978ea19d5 req-3f45055a-76f0-4137-9e9a-07c16891fd79 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:43.767172 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b39faca1-adb5-4690-a284-257978ea19d5 req-3f45055a-76f0-4137-9e9a-07c16891fd79 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:43.767679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-b39faca1-adb5-4690-a284-257978ea19d5 req-3f45055a-76f0-4137-9e9a-07c16891fd79 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:43.781571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-b39faca1-adb5-4690-a284-257978ea19d5 req-3f45055a-76f0-4137-9e9a-07c16891fd79 service nova] Creating event network-changed:6d27c2f1-1b30-4813-81d5-157b172a995b for instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 on hv-cinder-85220 Sep 01 16:48:43.786990 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-b39faca1-adb5-4690-a284-257978ea19d5 req-3f45055a-76f0-4137-9e9a-07c16891fd79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173980 Sep 01 16:48:43.787729 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 559/1102] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:48:44.115430 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:44.116282 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:44.122879 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:44.123391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:44.123895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:44.124705 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:44.125351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:44.125873 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:44.274140 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:44.282688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0dd69a24-5e01-4f99-b3e7-8d947912c4d7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.171138 Sep 01 16:48:44.283222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:44.283746 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 544/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:44 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:44.283949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:44.292567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:44.293072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:44.293487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:44.294209 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:44.294671 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:44.295091 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:44.426865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:44.435040 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1400e905-3fb4-45d6-a5cb-763897206205 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.156154 Sep 01 16:48:44.435625 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 560/1104] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:44 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:45.306752 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:45.307373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:45.314179 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.314716 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.315144 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.315844 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.316297 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.316722 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.456571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:45.457175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:45.464143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.464619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.465047 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.465730 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:45.466179 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:45.466618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:45.469699 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:45.478492 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1ee5cc01-a655-4091-aa55-d8ee8ee31b02 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.176445 Sep 01 16:48:45.479080 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 545/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:45 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:45.607404 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:45.615546 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f904d05a-bafe-4269-be9b-5d615d258635 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.162972 Sep 01 16:48:45.616163 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 561/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:45 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:46.500255 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:46.500895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:46.507598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:46.508083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:46.508518 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.509219 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:46.509672 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:46.510094 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.637588 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:46.638144 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:46.644701 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:46.645185 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:46.645618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.646342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:46.646822 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:46.647242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:46.652449 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:46.661071 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-95095245-3b27-429b-af02-89528f5b2ba7 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.164648 Sep 01 16:48:46.661764 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 546/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:46 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:46.792216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:46.800030 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5d8fdcf0-609d-485c-b0a7-c44029cc4509 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.166596 Sep 01 16:48:46.800592 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 562/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:46 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:47.683213 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:47.683868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:47.690289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.690791 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.691220 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.691902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.692349 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.692766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.822468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:47.823062 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:47.829214 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.829700 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.830135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.830864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:47.831317 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:47.831742 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:47.839358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:47.848493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-1d293fd3-2933-45eb-ad8c-00c5c4264345 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.169090 Sep 01 16:48:47.849045 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 547/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:47 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:47.972106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:47.979972 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-dbac7f58-1bfa-49b1-885d-3933c85dd496 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.162394 Sep 01 16:48:47.980553 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 563/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:47 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:48.870270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:48.870841 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:48.877134 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.877604 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.878104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:48.878866 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:48.879318 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:48.879734 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:49.000923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:49.001507 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:49.008169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:49.008640 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:49.009061 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:49.009747 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:49.010216 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:49.010635 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:49.022971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:49.031399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-debfbc2e-bb1c-4d9c-a3a5-922c1a25f742 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.165189 Sep 01 16:48:49.032177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 548/1111] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:48 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:49.143514 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:49.151105 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9483f2e7-a673-401e-8fbd-b72b038a5f0c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.154062 Sep 01 16:48:49.151662 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 564/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:48 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:50.054798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:50.055788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:50.062066 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.062578 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.063013 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.063704 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.064153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.064574 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.172352 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:50.172950 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:50.179739 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.180218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.180675 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.181367 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:50.181811 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:50.182246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:50.209176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:50.218047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-563d871d-e137-4d16-a942-4f3340a9a3da tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.168433 Sep 01 16:48:50.218674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 549/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:50 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:50.313591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:50.322015 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-be497d1c-ef26-4978-ac88-652eefe51fcb tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.153425 Sep 01 16:48:50.322600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 565/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:50 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:51.240448 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:51.241091 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:51.243589 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:51.249351 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.249826 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.250289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.250975 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.251427 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.251847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.345378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:51.346012 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:51.348106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:51.348764 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=6 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:51.355964 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.356442 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.356869 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.357556 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:51.358001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:51.358442 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:51.414584 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:51.423478 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d09534f8-16c0-4b8c-a11f-137e5006a76e tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.186893 Sep 01 16:48:51.424514 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 550/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:51 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:51.498791 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:51.506483 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-99e22223-4f05-4bf3-b648-ebe1133a4444 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.165353 Sep 01 16:48:51.507061 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 566/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:51 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:52.446603 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:52.447241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:52.453829 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.454340 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.454778 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.455467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.455920 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.456341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.527014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:52.527820 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:52.534681 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.535183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.535619 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.536342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:52.536799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:52.537428 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:52.650475 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:52.664938 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-70bb6e89-530e-4d45-927a-f3e9c118e943 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1756 microversion: 2.1 time: 0.222843 Sep 01 16:48:52.665859 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 551/1117] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:52 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:52.718582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:52.726568 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-bf17b3d4-3a92-4ff8-b176-9ee2e2bfe3af tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.203213 Sep 01 16:48:52.727158 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 567/1118] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:52 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:53.687296 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:53.687892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:53.695539 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.696010 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.696435 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.697116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.697560 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.697984 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.748384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:53.749255 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:53.758842 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.759341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.759931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.761482 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:53.762348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:53.763106 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:53.934595 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:53.943292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f5de0782-775f-43a8-aa10-00e3b1c2ab72 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1759 microversion: 2.1 time: 0.259694 Sep 01 16:48:53.943799 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 552/1119] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:53 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1759 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:53.958913 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:53.967284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5581d039-cc62-436a-ad4c-03d67011cc40 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.223600 Sep 01 16:48:53.967898 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 568/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:53 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:48:54.720969 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-e8a3e856-3bbe-4249-90f4-0e2a449f1387 req-7d236837-ab51-4069-a23d-9f48af57c741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905d7b51-28e3-45cb-b5cc-194f938b63a0", "name": "network-vif-plugged", "status": "completed", "tag": "6d27c2f1-1b30-4813-81d5-157b172a995b"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:48:54.731714 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e8a3e856-3bbe-4249-90f4-0e2a449f1387 req-7d236837-ab51-4069-a23d-9f48af57c741 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.732201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e8a3e856-3bbe-4249-90f4-0e2a449f1387 req-7d236837-ab51-4069-a23d-9f48af57c741 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.732609 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-e8a3e856-3bbe-4249-90f4-0e2a449f1387 req-7d236837-ab51-4069-a23d-9f48af57c741 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.743500 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-e8a3e856-3bbe-4249-90f4-0e2a449f1387 req-7d236837-ab51-4069-a23d-9f48af57c741 service nova] Creating event network-vif-plugged:6d27c2f1-1b30-4813-81d5-157b172a995b for instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 on hv-cinder-85220 Sep 01 16:48:54.748493 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-e8a3e856-3bbe-4249-90f4-0e2a449f1387 req-7d236837-ab51-4069-a23d-9f48af57c741 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151354 Sep 01 16:48:54.749075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 553/1121] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:48:54.988715 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:54.989271 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:54.995967 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.996447 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.996875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:54.997562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:54.998014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:54.998501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:55.135355 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:55.143316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-a5a46d01-669f-40fb-9c62-783492c55ecf tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.158315 Sep 01 16:48:55.144235 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 569/1122] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:54 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:56.166648 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:56.167335 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:56.173535 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:56.174297 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:56.174729 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:56.175411 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:56.175858 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:56.176275 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:56.180530 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:48:56.576237 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:56.584380 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c57fac17-99b6-476c-86a6-4ce24d00c756 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1264 microversion: 2.1 time: 0.423047 Sep 01 16:48:56.584956 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 554/1123] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:56 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1264 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:57.605597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:57.606218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:57.612934 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:57.613417 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:57.613853 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:57.614576 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:57.615028 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:57.615451 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:57.749566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:57.757798 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-cc050b3f-4fea-4b60-80d1-0daca13370bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1451 microversion: 2.1 time: 0.156683 Sep 01 16:48:57.758433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 570/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:57 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:57.778026 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:48:57.778660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:48:57.785422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:57.785903 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:57.786377 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:57.787078 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:48:57.787528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:48:57.787948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:48:57.930245 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:48:57.938851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-03418d19-9154-49e0-b66f-94583edfdae2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1451 microversion: 2.1 time: 0.164724 Sep 01 16:48:57.939418 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 555/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:48:57 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:48:59.994629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-bf8db714-f830-4b61-9057-41d09cc8fa50 req-647d5085-6a68-4667-b1c3-9a82caf0565e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905d7b51-28e3-45cb-b5cc-194f938b63a0", "tag": "6d27c2f1-1b30-4813-81d5-157b172a995b"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:00.010667 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-bf8db714-f830-4b61-9057-41d09cc8fa50 req-647d5085-6a68-4667-b1c3-9a82caf0565e service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:00.011032 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-bf8db714-f830-4b61-9057-41d09cc8fa50 req-647d5085-6a68-4667-b1c3-9a82caf0565e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:00.012431 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-bf8db714-f830-4b61-9057-41d09cc8fa50 req-647d5085-6a68-4667-b1c3-9a82caf0565e service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:00.031282 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-bf8db714-f830-4b61-9057-41d09cc8fa50 req-647d5085-6a68-4667-b1c3-9a82caf0565e service nova] Creating event network-changed:6d27c2f1-1b30-4813-81d5-157b172a995b for instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 on hv-cinder-85220 Sep 01 16:49:00.039129 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-bf8db714-f830-4b61-9057-41d09cc8fa50 req-647d5085-6a68-4667-b1c3-9a82caf0565e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049058 Sep 01 16:49:00.039922 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 571/1126] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:49:57.561145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1155834887"}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:57.561892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:57.564580 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=40 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:57.565270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=10 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:57.572103 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:57.572601 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:57.573044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:57.573767 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:57.574300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:57.574736 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:57.710967 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.network.security_group_api [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Removing security group 3bf1f17d-4109-4d0d-9101-aaf75c81c771 from port ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 Sep 01 16:49:58.023374 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-750b8622-7701-4892-b921-fc79b18b5cdf tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/action" status: 202 len: 0 microversion: 2.1 time: 0.465432 Sep 01 16:49:58.024127 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 556/1127] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Sep 1 16:49:57 2022] POST /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:49:58.046020 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-58658e90-a847-4027-a34f-684e92a33dcc req-ef3415da-7f2c-4cc3-af56-3b98afb547ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:49:58.053461 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:58.054114 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=96 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:49:58.074644 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-58658e90-a847-4027-a34f-684e92a33dcc req-ef3415da-7f2c-4cc3-af56-3b98afb547ee service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:58.075685 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-58658e90-a847-4027-a34f-684e92a33dcc req-ef3415da-7f2c-4cc3-af56-3b98afb547ee service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:58.076585 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-58658e90-a847-4027-a34f-684e92a33dcc req-ef3415da-7f2c-4cc3-af56-3b98afb547ee service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:58.119246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-58658e90-a847-4027-a34f-684e92a33dcc req-ef3415da-7f2c-4cc3-af56-3b98afb547ee service nova] Creating event network-changed:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:49:58.125308 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-58658e90-a847-4027-a34f-684e92a33dcc req-ef3415da-7f2c-4cc3-af56-3b98afb547ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088168 Sep 01 16:49:58.126165 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 572/1128] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:49:59.104710 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:59.105299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:59.111554 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:59.112128 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:59.112629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:59.113395 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:59.113944 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:59.114466 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:59.201317 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lazy-loading 'services' on Instance uuid 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:49:59.278184 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-9fc9fbf2-1af8-47bf-bec8-5d73faf6f4c8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments/72d8d11e-ca9d-45c4-bba2-8089662c0e84" status: 202 len: 0 microversion: 2.1 time: 0.178311 Sep 01 16:49:59.278814 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 557/1129] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:49:59 2022] DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments/72d8d11e-ca9d-45c4-bba2-8089662c0e84 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:49:59.288525 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:49:59.291513 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:49:59.299149 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:59.299868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:59.300292 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:59.301162 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:49:59.301627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:49:59.302175 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:49:59.333924 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-608cbc5b-a4dd-49e5-bed2-0108978e095b tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050235 Sep 01 16:49:59.334541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 573/1130] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:49:59 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:50:00.141228 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-717836c1-e236-4227-8e3c-82f87c7cc8cd req-c20ef6af-9c1a-42ca-9c28-5fffee4ed4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:50:00.151971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-717836c1-e236-4227-8e3c-82f87c7cc8cd req-c20ef6af-9c1a-42ca-9c28-5fffee4ed4aa service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:00.152471 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-717836c1-e236-4227-8e3c-82f87c7cc8cd req-c20ef6af-9c1a-42ca-9c28-5fffee4ed4aa service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:00.152894 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-717836c1-e236-4227-8e3c-82f87c7cc8cd req-c20ef6af-9c1a-42ca-9c28-5fffee4ed4aa service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:00.164218 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-717836c1-e236-4227-8e3c-82f87c7cc8cd req-c20ef6af-9c1a-42ca-9c28-5fffee4ed4aa service nova] Creating event network-changed:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:50:00.168984 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-717836c1-e236-4227-8e3c-82f87c7cc8cd req-c20ef6af-9c1a-42ca-9c28-5fffee4ed4aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Sep 01 16:50:00.169577 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 558/1131] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:50:00.348508 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:00.352246 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:00.359385 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:00.360560 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:00.361384 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:00.362397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:00.362931 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:00.363345 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:00.399019 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b9677cdb-2d07-426c-a915-97b27d83d561 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056333 Sep 01 16:50:00.399868 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 574/1132] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:50:00 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:50:01.412529 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:01.415300 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:01.421412 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:01.421888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:01.422344 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:01.423034 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:01.423477 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:01.423892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:01.454031 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d5729630-cb80-410c-a139-5eb19b89f9fa tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046268 Sep 01 16:50:01.454625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 559/1133] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Sep 1 16:50:01 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 16:50:01.465751 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:01.466372 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:01.472618 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:01.473135 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:01.473599 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:01.474342 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:01.474802 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:01.475238 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:01.552938 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] HTTP exception thrown: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f is not attached to volume 72d8d11e-ca9d-45c4-bba2-8089662c0e84 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Request method failure captured: Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments/72d8d11e-ca9d-45c4-bba2-8089662c0e84 HTTP/1.1 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOG_2H-74Ks3pol8pKiMtmUB_3qcihaX_I_sEf3e2Dr2Yk6dhOrMrSN7zn_zSYreE8-NjGcTK3_VxnxxQ6jlTys8gwn4O-dvt4oOCI-Mo8VaexcrMxR7HdVyH7ncX8wdjSJvKxMvPNwCzE8no68uq0MUVHRliRbyIVBdpWNXPT3hs2Y Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 1f62976899a74162b21efe5580758fd9 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-TestMinimumBasicScenario-518695736 Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:50:01.555433 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1f62976899a74162b21efe5580758fd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f62976899a74162b21efe5580758fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1f62976899a74162b21efe5580758fd9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f62976899a74162b21efe5580758fd9"}]}] Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-TestMinimumBasicScenario-518695736 Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 1f62976899a74162b21efe5580758fd9 Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-TestMinimumBasicScenario-518695736 Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-TestMinimumBasicScenario-518695736-project Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: fac40ee8cdc9495aa1c94f483f6fd6c5 Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-TestMinimumBasicScenario-518695736-project Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:50:01.557327 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f is not attached to volume 72d8d11e-ca9d-45c4-bba2-8089662c0e84 Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'server_id': '98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f', 'id': '72d8d11e-ca9d-45c4-bba2-8089662c0e84'} Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 72d8d11e-ca9d-45c4-bba2-8089662c0e84. Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:50:01.558275 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f is not attached to volume 72d8d11e-ca9d-45c4-bba2-8089662c0e84 Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f is not attached to volume 72d8d11e-ca9d-45c4-bba2-8089662c0e84 Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:50:01.560011 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Returning 404 to user: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f is not attached to volume 72d8d11e-ca9d-45c4-bba2-8089662c0e84 {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:50:01.561494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-13d5d7b3-c011-4fb7-8697-81b688c978ef tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments/72d8d11e-ca9d-45c4-bba2-8089662c0e84" status: 404 len: 154 microversion: 2.1 time: 0.095193 Sep 01 16:50:01.561494 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 575/1134] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Sep 1 16:50:01 2022] DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f/os-volume_attachments/72d8d11e-ca9d-45c4-bba2-8089662c0e84 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:50:02.699856 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:02.700391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:02.706781 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:02.707257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:02.707688 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:02.708420 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:02.708862 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:02.709281 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:02.734251 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:50:02.815813 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ffd6a4cd-ee2f-43eb-ae55-56bb46a016cd tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 204 len: 0 microversion: 2.1 time: 0.119215 Sep 01 16:50:02.816811 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 560/1135] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:50:02 2022] DELETE /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 16:50:02.825661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:02.826294 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:02.832947 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:02.833453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:02.833891 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:02.834650 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:02.835105 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:02.835528 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:02.972305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:02.981127 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8d4e997b-a324-490c-b4ba-b4bce06dfb34 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1553 microversion: 2.1 time: 0.159370 Sep 01 16:50:02.981697 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 576/1136] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:02 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:04.003875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:04.004618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:04.011151 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:04.011634 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:04.012070 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:04.012766 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:04.013224 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:04.013649 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:04.151202 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:04.161120 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f44cb53e-b0dc-424e-acb0-8cd7ff110292 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1553 microversion: 2.1 time: 0.161795 Sep 01 16:50:04.162025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 561/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:03 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:50:05.183587 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:05.184186 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:05.191492 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:05.191980 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:05.192565 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:05.193270 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:05.193758 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:05.195121 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:05.405956 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:05.415539 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-76770d1e-b6a1-41a3-815a-98bfc6b8f618 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1553 microversion: 2.1 time: 0.235734 Sep 01 16:50:05.416336 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 577/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:05 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:05.664196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-a34fde9f-539c-49c0-a6eb-7d27a1ebe842 req-0db84d9d-4020-48fb-b387-471a36746088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f", "name": "network-vif-deleted", "tag": "ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:50:05.675437 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-a34fde9f-539c-49c0-a6eb-7d27a1ebe842 req-0db84d9d-4020-48fb-b387-471a36746088 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:05.675914 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-a34fde9f-539c-49c0-a6eb-7d27a1ebe842 req-0db84d9d-4020-48fb-b387-471a36746088 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:05.676341 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-a34fde9f-539c-49c0-a6eb-7d27a1ebe842 req-0db84d9d-4020-48fb-b387-471a36746088 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:05.690870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-a34fde9f-539c-49c0-a6eb-7d27a1ebe842 req-0db84d9d-4020-48fb-b387-471a36746088 service nova] Creating event network-vif-deleted:ad668ccf-a91b-4cd2-bf47-65c5c7f4ae38 for instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f on hv-cinder-85220 Sep 01 16:50:05.696434 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-a34fde9f-539c-49c0-a6eb-7d27a1ebe842 req-0db84d9d-4020-48fb-b387-471a36746088 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036818 Sep 01 16:50:05.697052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 562/1139] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:50:06.437745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:06.438442 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:06.445958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:06.446467 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:06.446904 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:06.447600 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:06.448055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:06.448504 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:06.480321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:06.480706 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:06.481166 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:06.481611 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.objects.instance [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lazy-loading 'fault' on Instance uuid 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f {{(pid=120692) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:50:06.523472 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fac40ee8cdc9495aa1c94f483f6fd6c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f62976899a74162b21efe5580758fd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:50:06.536471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-5545634b-be72-4615-91f2-8ab8fd6320e8 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 200 len: 1347 microversion: 2.1 time: 0.102412 Sep 01 16:50:06.537101 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 578/1140] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:06 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:50:07.560808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:07.561494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] [instance: 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:50:07.567798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:07.568289 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:07.568697 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:07.569867 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:50:07.570337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:50:07.570756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:50:07.584192 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] HTTP exception thrown: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f could not be found. Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Request method failure captured: Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f HTTP/1.1 Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOG_2H-74Ks3pol8pKiMtmUB_3qcihaX_I_sEf3e2Dr2Yk6dhOrMrSN7zn_zSYreE8-NjGcTK3_VxnxxQ6jlTys8gwn4O-dvt4oOCI-Mo8VaexcrMxR7HdVyH7ncX8wdjSJvKxMvPNwCzE8no68uq0MUVHRliRbyIVBdpWNXPT3hs2Y Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 1f62976899a74162b21efe5580758fd9 Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-TestMinimumBasicScenario-518695736 Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:50:07.586827 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1f62976899a74162b21efe5580758fd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f62976899a74162b21efe5580758fd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1f62976899a74162b21efe5580758fd9", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1f62976899a74162b21efe5580758fd9"}]}] Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-TestMinimumBasicScenario-518695736 Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 1f62976899a74162b21efe5580758fd9 Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-TestMinimumBasicScenario-518695736 Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-TestMinimumBasicScenario-518695736-project Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: fac40ee8cdc9495aa1c94f483f6fd6c5 Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-TestMinimumBasicScenario-518695736-project Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f could not be found. Sep 01 16:50:07.588789 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f'} Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f could not be found. Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:50:07.589851 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f could not be found. Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f could not be found. Sep 01 16:50:07.591622 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:50:07.593153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Returning 404 to user: Instance 98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:50:07.593153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-104b792e-96a7-46d3-afe0-9ea3581758e6 tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f" status: 404 len: 111 microversion: 2.1 time: 0.032158 Sep 01 16:50:07.593153 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 563/1141] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:50:07 2022] GET /compute/v2.1/servers/98eb1eb0-8ec8-4d62-82d0-bc38b2519f6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 16:50:07.597724 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-c10a224f-082a-49b0-a745-606ec86828ed tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] Calling method '.version_select at 0x7f6c9cf05af0>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:50:07.617667 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-c10a224f-082a-49b0-a745-606ec86828ed tempest-TestMinimumBasicScenario-518695736 tempest-TestMinimumBasicScenario-518695736-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98136204" status: 202 len: 0 microversion: 2.1 time: 0.024139 Sep 01 16:50:07.618284 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 579/1142] 10.222.0.58 () {58 vars in 1266 bytes} [Thu Sep 1 16:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-98136204 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 16:51:17.995456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:17.996279 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:17.997311 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:51:17.997441 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:51:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 (ip 10.222.0.58) !!! Sep 01 16:51:18.002990 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:18.003489 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:18.012500 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:18.012982 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:18.013422 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:18.014123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:18.014615 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:18.015040 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:18.043507 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:51:18.122250 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-62ba612f-dce0-4de2-a45c-ce7ca718230b tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "DELETE /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 204 len: 0 microversion: 2.1 time: 0.128285 Sep 01 16:51:18.123027 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 564/1143] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:51:17 2022] DELETE /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:51:18.130584 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=40 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:18.131445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:18.133088 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:51:18.133344 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:51:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 (ip 10.222.0.58) !!! Sep 01 16:51:18.146629 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:18.147371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:18.154478 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:18.154963 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:18.155397 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:18.156102 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:18.156549 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:18.156971 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:18.764045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:18.772278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3efb1e77-6ca4-4485-a862-ecb64603171a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1576 microversion: 2.1 time: 0.644344 Sep 01 16:51:18.772839 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 580/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:18 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1576 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:19.793327 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:19.794029 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:19.800659 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:19.801637 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:19.802077 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:19.802828 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:19.803287 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:19.803725 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:19.993093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:20.001132 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-e66a31c1-1b7c-4c6b-bc21-e67e9234f71a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1576 microversion: 2.1 time: 0.212044 Sep 01 16:51:20.001754 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 565/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:19 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:20.971761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-8f55d20d-d539-4e4e-ba16-5584e62bc532 req-e6a41a42-f289-48af-b1d3-556ff7409577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905d7b51-28e3-45cb-b5cc-194f938b63a0", "name": "network-vif-deleted", "tag": "6d27c2f1-1b30-4813-81d5-157b172a995b"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:20.989136 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-8f55d20d-d539-4e4e-ba16-5584e62bc532 req-e6a41a42-f289-48af-b1d3-556ff7409577 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:20.989945 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-8f55d20d-d539-4e4e-ba16-5584e62bc532 req-e6a41a42-f289-48af-b1d3-556ff7409577 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:20.991477 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-8f55d20d-d539-4e4e-ba16-5584e62bc532 req-e6a41a42-f289-48af-b1d3-556ff7409577 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:21.009591 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-8f55d20d-d539-4e4e-ba16-5584e62bc532 req-e6a41a42-f289-48af-b1d3-556ff7409577 service nova] Creating event network-vif-deleted:6d27c2f1-1b30-4813-81d5-157b172a995b for instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 on hv-cinder-85220 Sep 01 16:51:21.017077 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-8f55d20d-d539-4e4e-ba16-5584e62bc532 req-e6a41a42-f289-48af-b1d3-556ff7409577 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049656 Sep 01 16:51:21.019178 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 581/1146] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:21.026328 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:21.027629 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:21.038950 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:21.039337 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:21.040078 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:21.041208 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:21.041700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:21.042167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:21.142137 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:21.152047 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-f113a7a6-2cb3-49b6-99d4-e6e0ed34910f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 200 len: 1224 microversion: 2.1 time: 0.132803 Sep 01 16:51:21.153051 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 566/1147] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:21 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:22.176537 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:22.177254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:22.183638 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:22.184115 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:22.184542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:22.185233 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:22.185679 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:22.186094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:22.199708 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] HTTP exception thrown: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Request method failure captured: Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 HTTP/1.1 Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOJH6ywePjbYRPznDq9A6engLpN0GrJh6lCheF-Kg9BxtkF4LJfkETkPWqyqm2ymL1L7fX4XGZpxZeqTwVIzNoVS41USCYsqD3ackVtYAFSPj9dXIkNREYD2dQauNsZLJZdwUFdffJ_H73Sn1TYXTxVrEJ2VEUUA62qZxWIjOxQbj8w Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:51:22.201339 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20a271a8da6d423db38d5730006af839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20a271a8da6d423db38d5730006af839", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}] Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-TestVolumeBootPattern-990473635 Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 8fa0f309a0b749b1a782d489f1f352af Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:51:22.203274 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '905d7b51-28e3-45cb-b5cc-194f938b63a0'} Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:51:22.204381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:51:22.206111 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:51:22.208183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Returning 404 to user: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:51:22.208183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-8eabc287-983b-4c0c-83e4-e44a55615a75 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 404 len: 111 microversion: 2.1 time: 0.031495 Sep 01 16:51:22.208183 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 582/1148] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:22 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:51:22.301386 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1120236020", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-442711278", "security_groups": [{"name": "tempest-secgroup-smoke-163787977"}], "block_device_mapping_v2": [{"uuid": "f69f019a-e86a-43f2-a9a3-b67b6f88bae1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63275c53-398b-4204-8b5c-6e1c3ef9f8ff"}]}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:22.416145 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] validate_networks() for [('63275c53-398b-4204-8b5c-6e1c3ef9f8ff', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:51:22.878390 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:51:22.878820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:51:22.879361 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:51:22.879838 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:51:22.880753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:51:22.890253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:22.890751 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:22.891196 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:22.891937 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:22.892397 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:22.892834 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:22.911033 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for project 20a271a8da6d423db38d5730006af839. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:51:22.915212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for user 8fa0f309a0b749b1a782d489f1f352af and project 20a271a8da6d423db38d5730006af839. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:51:22.976163 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:51:22.978403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f69f019a-e86a-43f2-a9a3-b67b6f88bae1',volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:51:23.128735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bd38dac8-7881-4662-84f1-60ccb926b8e3 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.831282 Sep 01 16:51:23.129467 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 567/1149] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:51:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:51:23.140486 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f6a03d6e-3e21-473b-9d5a-8431afb96891 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:23.141101 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f6a03d6e-3e21-473b-9d5a-8431afb96891 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:23.198735 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f6a03d6e-3e21-473b-9d5a-8431afb96891 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:23.206169 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f6a03d6e-3e21-473b-9d5a-8431afb96891 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1094 microversion: 2.1 time: 0.069540 Sep 01 16:51:23.206806 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 583/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:23 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:24.227555 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:24.228182 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:24.235456 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:24.236019 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:24.236470 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:24.237280 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:24.237771 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:24.238230 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:24.343528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:24.352630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-ee47ce5e-780d-4038-9550-930f6f1f0861 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1200 microversion: 2.1 time: 0.129508 Sep 01 16:51:24.353226 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 568/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:24 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1200 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:25.375082 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:25.375865 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:25.383832 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:25.384324 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:25.384762 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:25.385462 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:25.385920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:25.386388 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:25.664198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:25.672624 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b69cb43e-767a-4211-8d73-2b7a8c6fdc86 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.301540 Sep 01 16:51:25.673205 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 584/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:25 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:26.007176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-0239056b-2b7a-47ea-8db4-9258d7aed3e7 req-d800bbc0-f929-4ecc-8d92-f8094767a772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a36ee3-6446-492d-982a-83430d44aca9", "tag": "a837cb16-3087-410e-8fd9-bd15170b5a41"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:26.020504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-0239056b-2b7a-47ea-8db4-9258d7aed3e7 req-d800bbc0-f929-4ecc-8d92-f8094767a772 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:26.020983 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-0239056b-2b7a-47ea-8db4-9258d7aed3e7 req-d800bbc0-f929-4ecc-8d92-f8094767a772 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:26.021461 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-0239056b-2b7a-47ea-8db4-9258d7aed3e7 req-d800bbc0-f929-4ecc-8d92-f8094767a772 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:26.032985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-0239056b-2b7a-47ea-8db4-9258d7aed3e7 req-d800bbc0-f929-4ecc-8d92-f8094767a772 service nova] Creating event network-changed:a837cb16-3087-410e-8fd9-bd15170b5a41 for instance 93a36ee3-6446-492d-982a-83430d44aca9 on hv-cinder-85220 Sep 01 16:51:26.038485 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-0239056b-2b7a-47ea-8db4-9258d7aed3e7 req-d800bbc0-f929-4ecc-8d92-f8094767a772 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036577 Sep 01 16:51:26.039099 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 569/1153] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:26.695436 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:26.696180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:26.702965 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:26.703799 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:26.704557 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:26.705786 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:26.706628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:26.707418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:26.859672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:26.868353 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3afda892-e8c6-4da4-991a-17411ac3f55d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.177670 Sep 01 16:51:26.868958 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 585/1154] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:26 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:51:27.891009 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:27.891825 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:27.898915 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:27.899391 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:27.899820 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:27.900508 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:27.900957 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:27.901381 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:28.035961 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:28.043985 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-a28369e3-8858-48bb-807e-07268f726e53 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.158125 Sep 01 16:51:28.044569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 570/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:27 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:29.068170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:29.069207 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:29.076373 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:29.076894 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:29.077359 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:29.078446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:29.078945 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:29.079438 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:29.227554 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:29.235656 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-16b299f2-4581-4cf5-ae96-cc0e879169a7 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.173504 Sep 01 16:51:29.236263 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 586/1156] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:29 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:30.262417 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:30.263053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:30.269590 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:30.270075 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:30.270542 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:30.271241 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:30.271694 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:30.272116 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:30.404111 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:30.411991 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-352466d9-00cf-47be-94a3-ba546df348b4 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.153671 Sep 01 16:51:30.412572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 571/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:30 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:31.432394 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:31.433001 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:31.440579 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:31.441734 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:31.442382 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:31.443243 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:31.444378 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:31.445215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:31.583783 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:31.591743 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-d759f5b1-1f37-4bfe-bfce-3a90e1c19849 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.163227 Sep 01 16:51:31.592321 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 587/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:31 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:32.612623 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:32.613223 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:32.619733 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:32.620207 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:32.620638 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:32.621319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:32.621762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:32.622176 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:32.758875 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:32.766803 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d0588f05-a496-436f-9fd4-4e5975096063 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.158174 Sep 01 16:51:32.767384 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 572/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:32 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:33.788728 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:33.789761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:33.792702 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:33.801242 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:33.802055 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:33.802763 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:33.803780 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:33.804292 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:33.804923 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:33.945944 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:33.953901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2a2bb1b6-3a54-4304-b144-dcb11d037b42 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.169542 Sep 01 16:51:33.954518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 588/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:33 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:51:34.975882 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:34.976451 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:34.978452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:34.979304 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:51:34.985788 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:34.986301 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:34.986740 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:34.987443 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:34.987895 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:34.988326 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:35.128291 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:35.137494 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-89021fde-2c83-4f7c-8ec7-5a10cda08e71 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.166003 Sep 01 16:51:35.138098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 573/1161] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:34 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:36.159036 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:36.159712 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:36.167650 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:36.168143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:36.168580 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:36.169307 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:36.169761 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:36.170219 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:36.317073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:36.323661 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-b674e26d-877e-4760-89a5-ee03f171649e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.168740 Sep 01 16:51:36.324250 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 589/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:36 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:37.310596 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-9fedd5bf-6d32-4f9b-af33-018796baa0b7 req-2d42934b-d339-4e4f-802c-89e602a6935f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a36ee3-6446-492d-982a-83430d44aca9", "name": "network-vif-plugged", "status": "completed", "tag": "a837cb16-3087-410e-8fd9-bd15170b5a41"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:37.328753 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-9fedd5bf-6d32-4f9b-af33-018796baa0b7 req-2d42934b-d339-4e4f-802c-89e602a6935f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:37.329359 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-9fedd5bf-6d32-4f9b-af33-018796baa0b7 req-2d42934b-d339-4e4f-802c-89e602a6935f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:37.329870 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-9fedd5bf-6d32-4f9b-af33-018796baa0b7 req-2d42934b-d339-4e4f-802c-89e602a6935f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:37.344045 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:37.344674 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:37.352212 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-9fedd5bf-6d32-4f9b-af33-018796baa0b7 req-2d42934b-d339-4e4f-802c-89e602a6935f service nova] Creating event network-vif-plugged:a837cb16-3087-410e-8fd9-bd15170b5a41 for instance 93a36ee3-6446-492d-982a-83430d44aca9 on hv-cinder-85220 Sep 01 16:51:37.352521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:37.352929 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:37.353370 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:37.354113 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:37.354613 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:37.355037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:37.369511 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-9fedd5bf-6d32-4f9b-af33-018796baa0b7 req-2d42934b-d339-4e4f-802c-89e602a6935f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066080 Sep 01 16:51:37.370117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 574/1163] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:51:37.517749 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:37.526620 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4f65a4d2-e01e-4616-b828-2120b04d19c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.186223 Sep 01 16:51:37.527338 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 590/1164] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:37 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:51:38.548481 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:38.549270 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:38.556913 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:38.557376 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:38.557815 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:38.558589 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:38.559041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:38.559465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:38.727810 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:38.735847 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d5587823-6b12-46fb-af02-2beba1d891bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1265 microversion: 2.1 time: 0.192012 Sep 01 16:51:38.737570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 575/1165] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:38 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:39.757357 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:39.757914 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:39.764779 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:39.765254 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:39.765680 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:39.766590 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:39.767037 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:39.767453 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:39.923916 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:39.932826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2a1b9215-853c-491f-9cad-f17289dc412d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1452 microversion: 2.1 time: 0.179864 Sep 01 16:51:39.933417 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 591/1166] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:39 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:39.966973 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:51:39.967972 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:51:39.978350 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:39.979123 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:39.979843 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:39.980948 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:39.981685 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:39.982395 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:40.137700 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:51:40.145892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-eaa02609-a10e-416a-9ffc-47b92ce123ab tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1452 microversion: 2.1 time: 0.185467 Sep 01 16:51:40.146528 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 576/1167] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:51:39 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:51:42.109457 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-6f5ae77a-68f5-419d-b6fb-3b5e9b5163e8 req-44029dc7-b575-49eb-b77b-b06080c44add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a36ee3-6446-492d-982a-83430d44aca9", "tag": "a837cb16-3087-410e-8fd9-bd15170b5a41"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:51:42.119981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-6f5ae77a-68f5-419d-b6fb-3b5e9b5163e8 req-44029dc7-b575-49eb-b77b-b06080c44add service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:51:42.119981 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-6f5ae77a-68f5-419d-b6fb-3b5e9b5163e8 req-44029dc7-b575-49eb-b77b-b06080c44add service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:51:42.120468 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-6f5ae77a-68f5-419d-b6fb-3b5e9b5163e8 req-44029dc7-b575-49eb-b77b-b06080c44add service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:51:42.132670 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-6f5ae77a-68f5-419d-b6fb-3b5e9b5163e8 req-44029dc7-b575-49eb-b77b-b06080c44add service nova] Creating event network-changed:a837cb16-3087-410e-8fd9-bd15170b5a41 for instance 93a36ee3-6446-492d-982a-83430d44aca9 on hv-cinder-85220 Sep 01 16:51:42.137949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-6f5ae77a-68f5-419d-b6fb-3b5e9b5163e8 req-44029dc7-b575-49eb-b77b-b06080c44add service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032112 Sep 01 16:51:42.138521 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 592/1168] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:53:42.617719 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:42.618618 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:42.620472 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 01 16:53:42.620653 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:53:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.58) !!! Sep 01 16:53:42.626758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-286820494", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-442711278", "security_groups": [{"name": "tempest-secgroup-smoke-163787977"}], "block_device_mapping_v2": [{"uuid": "8d1a6352-7ea6-4777-9a6d-6bca8569c1ce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "63275c53-398b-4204-8b5c-6e1c3ef9f8ff"}]}} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:53:42.760940 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.network.neutron [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] validate_networks() for [('63275c53-398b-4204-8b5c-6e1c3ef9f8ff', None, None, None, None, None)] {{(pid=120693) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 16:53:43.147591 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Flavor limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 16:53:43.148020 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Image limits 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 16:53:43.148522 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Flavor pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 16:53:43.148990 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Image pref 0:0:0 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 16:53:43.149564 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.virt.hardware [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120693) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 16:53:43.158758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:43.159231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:43.159701 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:43.160452 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:43.160899 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:43.161319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:43.178749 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for project 20a271a8da6d423db38d5730006af839. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 16:53:43.182786 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.quota [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Getting quotas for user 8fa0f309a0b749b1a782d489f1f352af and project 20a271a8da6d423db38d5730006af839. Resources: {'instances', 'cores', 'ram'} {{(pid=120693) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 16:53:43.241250 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Going to run 1 instances... {{(pid=120693) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 16:53:43.243432 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d1a6352-7ea6-4777-9a6d-6bca8569c1ce',volume_size=None,volume_type=None)] {{(pid=120693) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 16:53:43.411798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-bc41c998-fa02-4ad3-90f9-9f080be42371 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.795804 Sep 01 16:53:43.413165 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 577/1169] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Sep 1 16:53:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 16:53:43.425811 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9f2dadd4-9911-42a3-b531-21636d26e3ca] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:53:43.426949 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=28 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:43.428500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=60 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:43.431057 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:53:43.431283 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 (ip 10.222.0.58) !!! Sep 01 16:53:43.441041 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-f42fb959-58e8-47b5-9f12-a342f35f09ec tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:43.442562 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-f42fb959-58e8-47b5-9f12-a342f35f09ec tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:43.511391 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-f42fb959-58e8-47b5-9f12-a342f35f09ec tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:43.518647 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-f42fb959-58e8-47b5-9f12-a342f35f09ec tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1093 microversion: 2.1 time: 0.096927 Sep 01 16:53:43.519215 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 593/1170] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:43 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1093 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:44.540285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:44.541102 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:44.547348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:44.548404 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:44.548926 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:44.549906 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:44.551598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:44.551598 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:44.635055 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:44.645239 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-483de694-93d2-4cbd-af87-b87a98d03d49 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1199 microversion: 2.1 time: 0.109622 Sep 01 16:53:44.646167 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 578/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:44 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1199 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:45.670243 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:45.671519 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:45.684348 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] [9f2dadd4-9911-42a3-b531-21636d26e3ca] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58862. Sep 01 16:53:45.689341 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:45.689826 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:45.690526 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:45.691489 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:45.691902 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:45.692332 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:45.915541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:45.924446 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-3f01ad9d-10e4-46bd-ab04-bbfc7ca8469d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.258017 Sep 01 16:53:45.925212 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 594/1172] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:45 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:46.289433 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-49e79fda-fa56-4f17-bfc6-0448a22e5623 req-16bc7dd7-0ee4-46ac-9d1b-890a78792c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c431e38-6bca-4195-a9ca-3d39d8369493", "tag": "b0570d06-761e-4a98-a71d-1f1686f2a560"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:53:46.300647 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-49e79fda-fa56-4f17-bfc6-0448a22e5623 req-16bc7dd7-0ee4-46ac-9d1b-890a78792c58 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:46.301118 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-49e79fda-fa56-4f17-bfc6-0448a22e5623 req-16bc7dd7-0ee4-46ac-9d1b-890a78792c58 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:46.301552 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-49e79fda-fa56-4f17-bfc6-0448a22e5623 req-16bc7dd7-0ee4-46ac-9d1b-890a78792c58 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:46.313310 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-49e79fda-fa56-4f17-bfc6-0448a22e5623 req-16bc7dd7-0ee4-46ac-9d1b-890a78792c58 service nova] Creating event network-changed:b0570d06-761e-4a98-a71d-1f1686f2a560 for instance 8c431e38-6bca-4195-a9ca-3d39d8369493 on hv-cinder-85220 Sep 01 16:53:46.318630 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-49e79fda-fa56-4f17-bfc6-0448a22e5623 req-16bc7dd7-0ee4-46ac-9d1b-890a78792c58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103149 Sep 01 16:53:46.319257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 579/1173] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:53:46.947928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:46.948621 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:46.955808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:46.956302 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:46.956741 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:46.957454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:46.957907 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:46.958371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:47.101961 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:47.109657 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-47bfc63d-8f85-4295-ba5c-04281c753f4a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.165726 Sep 01 16:53:47.110251 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 595/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:46 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:48.132011 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:48.132761 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:48.139473 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:48.139960 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:48.140403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:48.141154 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:48.142083 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:48.142546 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:48.378965 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:48.387667 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-3eb31b42-6d27-4f8c-a805-b38ed86c18ea tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.260682 Sep 01 16:53:48.388358 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 580/1175] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:48 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:49.409454 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:49.410092 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:49.416766 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:49.417240 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:49.417697 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:49.418418 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:49.418871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:49.419297 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:49.554716 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:49.562450 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-ab0b2a1c-1743-4e8c-93bc-b0904cb67037 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.157350 Sep 01 16:53:49.563031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 596/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:49 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:50.583772 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:50.584375 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:50.590612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:50.591098 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:50.591537 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:50.592231 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:50.592689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:50.593117 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:50.729139 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:50.737599 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-09fe4685-60a8-4bfb-a557-9a7ca529e502 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.157971 Sep 01 16:53:50.738177 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 581/1177] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:50 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:51.758260 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:51.758854 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:51.765386 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:51.765864 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:51.766936 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:51.767627 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:51.768080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:51.768501 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:51.903304 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:51.910968 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-987553a2-7202-4f13-80fd-a20c3a26e96d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.156576 Sep 01 16:53:51.911542 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 597/1178] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:51 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:52.932257 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:52.932868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:52.939576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:52.940060 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:52.940504 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:52.941199 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:52.941660 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:52.942087 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:53.076201 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:53.084656 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-2157c411-2789-4dbf-9071-e43e8ead26c5 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.156318 Sep 01 16:53:53.085236 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 582/1179] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:52 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:54.105876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:54.106500 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:54.108771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell0:SELECT=2 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:54.114962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:54.115471 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:54.115906 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:54.116597 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:54.117046 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:54.117463 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:54.255771 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:54.263886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-231af1e0-b85c-4204-896a-f4c51558aa9c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.161906 Sep 01 16:53:54.264518 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 598/1180] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:54 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:55.285500 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:55.286180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:55.288053 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=2 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:55.288706 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell0:SELECT=6 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:53:55.295152 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:55.295627 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:55.296052 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:55.296735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:55.297819 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:55.298345 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:55.439666 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:55.449240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-7c5976d4-0c48-4371-9d16-9103ab3877cc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.168047 Sep 01 16:53:55.450119 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 583/1181] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:55 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:53:56.470892 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:56.471506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:56.477424 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:56.477901 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:56.478367 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:56.479061 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:56.479505 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:56.479921 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:56.622432 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:56.631018 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-345f9723-67a8-4a72-a0e1-8b57d62b9c7f tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.164543 Sep 01 16:53:56.631615 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 599/1182] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:56 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:57.652513 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:57.653188 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:57.660041 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:57.660521 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:57.660955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:57.661651 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:57.662104 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:57.662578 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:57.806689 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:57.815665 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-0f5d172f-0a47-47c5-a68c-f62c60969bee tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.167156 Sep 01 16:53:57.816319 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 584/1183] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:57 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:53:58.117278 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-cb6f1f80-78b7-4edd-a64a-65654af243b6 req-73725db2-b967-4eb8-89a5-68f571904d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c431e38-6bca-4195-a9ca-3d39d8369493", "name": "network-vif-plugged", "status": "completed", "tag": "b0570d06-761e-4a98-a71d-1f1686f2a560"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:53:58.128222 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-cb6f1f80-78b7-4edd-a64a-65654af243b6 req-73725db2-b967-4eb8-89a5-68f571904d3c service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:58.128699 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-cb6f1f80-78b7-4edd-a64a-65654af243b6 req-73725db2-b967-4eb8-89a5-68f571904d3c service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:58.129123 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-cb6f1f80-78b7-4edd-a64a-65654af243b6 req-73725db2-b967-4eb8-89a5-68f571904d3c service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:58.142957 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-cb6f1f80-78b7-4edd-a64a-65654af243b6 req-73725db2-b967-4eb8-89a5-68f571904d3c service nova] Creating event network-vif-plugged:b0570d06-761e-4a98-a71d-1f1686f2a560 for instance 8c431e38-6bca-4195-a9ca-3d39d8369493 on hv-cinder-85220 Sep 01 16:53:58.148313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-cb6f1f80-78b7-4edd-a64a-65654af243b6 req-73725db2-b967-4eb8-89a5-68f571904d3c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105619 Sep 01 16:53:58.149029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 600/1184] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:53:58.841776 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:53:58.842430 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:53:58.849559 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:58.850046 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:58.850525 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:58.852511 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:53:58.852981 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:53:58.853413 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:53:58.993285 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:53:59.002874 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-d4082971-0ec6-4be9-943e-d9e5167132f2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.164994 Sep 01 16:53:59.003459 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 585/1185] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:53:58 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:54:00.028495 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:00.029462 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:00.036717 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:00.037198 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:00.037633 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:00.038398 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:00.038876 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:00.039316 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:00.187954 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:00.195879 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-4b17777b-f90e-4048-aae2-de705ce7e8bd tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1264 microversion: 2.1 time: 0.172312 Sep 01 16:54:00.196414 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 601/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:00 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:01.217669 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:01.218307 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:01.225082 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.225621 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.226025 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:01.226918 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.227253 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.227676 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:01.369142 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:01.377787 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-51ccc902-fad6-4b08-a8de-2630296b8d96 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1452 microversion: 2.1 time: 0.163960 Sep 01 16:54:01.378399 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 586/1187] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:01 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:01.397637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:54:01.398279 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:54:01.405595 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.406073 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.407492 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:01.407760 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:01.408204 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:01.408628 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:01.557419 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:54:01.567067 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-9e973057-9351-40d1-b075-e24f54ee1e11 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1452 microversion: 2.1 time: 0.173039 Sep 01 16:54:01.567571 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 602/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:54:01 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:54:03.353392 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-2dfadfb6-2b90-4ce5-a93f-1d38d9fcb691 req-5fcb4514-b426-4ccf-bc93-f71227589216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c431e38-6bca-4195-a9ca-3d39d8369493", "tag": "b0570d06-761e-4a98-a71d-1f1686f2a560"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:54:03.363740 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-2dfadfb6-2b90-4ce5-a93f-1d38d9fcb691 req-5fcb4514-b426-4ccf-bc93-f71227589216 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:54:03.364219 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-2dfadfb6-2b90-4ce5-a93f-1d38d9fcb691 req-5fcb4514-b426-4ccf-bc93-f71227589216 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:54:03.364645 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-2dfadfb6-2b90-4ce5-a93f-1d38d9fcb691 req-5fcb4514-b426-4ccf-bc93-f71227589216 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:54:03.376184 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-2dfadfb6-2b90-4ce5-a93f-1d38d9fcb691 req-5fcb4514-b426-4ccf-bc93-f71227589216 service nova] Creating event network-changed:b0570d06-761e-4a98-a71d-1f1686f2a560 for instance 8c431e38-6bca-4195-a9ca-3d39d8369493 on hv-cinder-85220 Sep 01 16:54:03.381584 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-2dfadfb6-2b90-4ce5-a93f-1d38d9fcb691 req-5fcb4514-b426-4ccf-bc93-f71227589216 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031976 Sep 01 16:54:03.382602 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 587/1189] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:55:53.259996 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:55:53.260626 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR oslo.messaging._drivers.impl_rabbit [-] [65a2aab0-f91a-4d33-905c-7ab7bba2b0b3] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 16:55:53.261031 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:55:53.261299 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:53.262690 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG dbcounter [-] [120693] Writing DB stats nova_cell1:SELECT=54 {{(pid=120693) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:53.263678 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:55:53.263835 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Thu Sep 1 16:55:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.58) !!! Sep 01 16:55:53.267672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_api:SELECT=22 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:53.268493 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG dbcounter [-] [120692] Writing DB stats nova_cell1:SELECT=50 {{(pid=120692) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 16:55:53.269567 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 16:55:53.269808 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [req-d6127f1d-b73e-4199-aa3b-03e37fb84b4a req-8080ff6b-7b52-4f63-a76c-8a02bbaacc03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c431e38-6bca-4195-a9ca-3d39d8369493", "tag": "b0570d06-761e-4a98-a71d-1f1686f2a560"}]} {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:55:53.269978 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Thu Sep 1 16:55:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 (ip 10.222.0.58) !!! Sep 01 16:55:53.286485 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-d6127f1d-b73e-4199-aa3b-03e37fb84b4a req-8080ff6b-7b52-4f63-a76c-8a02bbaacc03 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:53.286971 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-d6127f1d-b73e-4199-aa3b-03e37fb84b4a req-8080ff6b-7b52-4f63-a76c-8a02bbaacc03 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:53.287147 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:53.287403 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [req-d6127f1d-b73e-4199-aa3b-03e37fb84b4a req-8080ff6b-7b52-4f63-a76c-8a02bbaacc03 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:53.287719 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:53.288422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:53.289159 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:53.289610 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:53.290029 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:53.301955 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.compute.server_external_events [req-d6127f1d-b73e-4199-aa3b-03e37fb84b4a req-8080ff6b-7b52-4f63-a76c-8a02bbaacc03 service nova] Creating event network-changed:b0570d06-761e-4a98-a71d-1f1686f2a560 for instance 8c431e38-6bca-4195-a9ca-3d39d8369493 on hv-cinder-85220 Sep 01 16:55:53.307007 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [req-d6127f1d-b73e-4199-aa3b-03e37fb84b4a req-8080ff6b-7b52-4f63-a76c-8a02bbaacc03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049103 Sep 01 16:55:53.307625 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 588/1190] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 16:55:53.323536 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Going to try to terminate instance {{(pid=120692) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:55:53.414143 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1141d638-1a1b-49c8-8526-32af5d2a3796 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 204 len: 0 microversion: 2.1 time: 0.160114 Sep 01 16:55:53.418678 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 603/1191] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:55:53 2022] DELETE /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:55:53.425572 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:55:53.426588 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:55:53.444646 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:53.445139 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:53.445569 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:53.446302 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:53.446758 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:53.447200 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:53.593240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:55:53.602612 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8e989eef-6428-4947-a5b1-380059411130 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1576 microversion: 2.1 time: 0.181925 Sep 01 16:55:53.603331 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 589/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:55:53 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 16:55:54.627456 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:55:54.628229 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:55:54.635237 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:54.635745 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:54.636170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:54.637132 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:54.637582 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:54.637998 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:54.843566 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:55:54.852243 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-2e3e18d1-60a4-4cb2-a41f-35909163b01e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1576 microversion: 2.1 time: 0.229098 Sep 01 16:55:54.852833 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 604/1193] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:55:54 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:55:55.874932 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:55:55.875516 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:55:55.883292 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:55.883774 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:55.884205 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:55.884900 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:55.885348 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:55.885763 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:55.905585 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO oslo.messaging._drivers.impl_rabbit [-] [65a2aab0-f91a-4d33-905c-7ab7bba2b0b3] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 58964. Sep 01 16:55:56.033425 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:55:56.041735 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-32386d15-b2aa-44d4-b424-a1c79f70858d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1458 microversion: 2.1 time: 0.170955 Sep 01 16:55:56.042455 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 590/1194] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:55:55 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1458 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:55:56.190823 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-a9dcdd27-a7f2-4bea-9d07-b6bc4f52a86c req-4a54d334-10b3-4339-92f9-8c595afeff7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c431e38-6bca-4195-a9ca-3d39d8369493", "name": "network-vif-deleted", "tag": "b0570d06-761e-4a98-a71d-1f1686f2a560"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:55:56.200953 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a9dcdd27-a7f2-4bea-9d07-b6bc4f52a86c req-4a54d334-10b3-4339-92f9-8c595afeff7f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:56.201473 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a9dcdd27-a7f2-4bea-9d07-b6bc4f52a86c req-4a54d334-10b3-4339-92f9-8c595afeff7f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:56.201994 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a9dcdd27-a7f2-4bea-9d07-b6bc4f52a86c req-4a54d334-10b3-4339-92f9-8c595afeff7f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:56.214305 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-a9dcdd27-a7f2-4bea-9d07-b6bc4f52a86c req-4a54d334-10b3-4339-92f9-8c595afeff7f service nova] Creating event network-vif-deleted:b0570d06-761e-4a98-a71d-1f1686f2a560 for instance 8c431e38-6bca-4195-a9ca-3d39d8369493 on hv-cinder-85220 Sep 01 16:55:56.219328 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-a9dcdd27-a7f2-4bea-9d07-b6bc4f52a86c req-4a54d334-10b3-4339-92f9-8c595afeff7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088451 Sep 01 16:55:56.219933 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 605/1195] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:55:57.064268 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:55:57.064868 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:55:57.071644 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:57.072129 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:57.072570 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:57.073274 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:57.073727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:57.074158 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:57.108713 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:57.109254 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:57.109674 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:57.110130 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.objects.instance [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lazy-loading 'fault' on Instance uuid 8c431e38-6bca-4195-a9ca-3d39d8369493 {{(pid=120693) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 16:55:57.158038 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:55:57.166108 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-97d419f7-e502-4b8e-86df-211ff104e6d9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 200 len: 1183 microversion: 2.1 time: 0.105898 Sep 01 16:55:57.166769 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 591/1196] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:55:57 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 1183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:55:58.188400 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:55:58.189094 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 8c431e38-6bca-4195-a9ca-3d39d8369493] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:55:58.195445 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:58.195920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:58.196347 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:58.197035 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:55:58.197480 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:55:58.197893 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:55:58.211381 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] HTTP exception thrown: Instance 8c431e38-6bca-4195-a9ca-3d39d8369493 could not be found. Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Request method failure captured: Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 HTTP/1.1 Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOJH6ywePjbYRPznDq9A6engLpN0GrJh6lCheF-Kg9BxtkF4LJfkETkPWqyqm2ymL1L7fX4XGZpxZeqTwVIzNoVS41USCYsqD3ackVtYAFSPj9dXIkNREYD2dQauNsZLJZdwUFdffJ_H73Sn1TYXTxVrEJ2VEUUA62qZxWIjOxQbj8w Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:55:58.213014 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20a271a8da6d423db38d5730006af839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20a271a8da6d423db38d5730006af839", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}] Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-TestVolumeBootPattern-990473635 Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 8fa0f309a0b749b1a782d489f1f352af Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 8c431e38-6bca-4195-a9ca-3d39d8369493 could not be found. Sep 01 16:55:58.215767 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '8c431e38-6bca-4195-a9ca-3d39d8369493'} Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c431e38-6bca-4195-a9ca-3d39d8369493 could not be found. Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:55:58.217363 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c431e38-6bca-4195-a9ca-3d39d8369493 could not be found. Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c431e38-6bca-4195-a9ca-3d39d8369493 could not be found. Sep 01 16:55:58.220928 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:55:58.223867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Returning 404 to user: Instance 8c431e38-6bca-4195-a9ca-3d39d8369493 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:55:58.223867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-e6b90400-434c-4519-aed9-cf9ffe03c53c tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493" status: 404 len: 111 microversion: 2.1 time: 0.030988 Sep 01 16:55:58.223867 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 606/1197] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:55:58 2022] GET /compute/v2.1/servers/8c431e38-6bca-4195-a9ca-3d39d8369493 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:01.319120 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-a6b2a507-2f1a-4d0e-858c-c0278857b3fe req-73839f7a-db45-4908-806f-5117dc10c299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93a36ee3-6446-492d-982a-83430d44aca9", "tag": "a837cb16-3087-410e-8fd9-bd15170b5a41"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:56:01.323370 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:01.323874 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:01.330971 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a6b2a507-2f1a-4d0e-858c-c0278857b3fe req-73839f7a-db45-4908-806f-5117dc10c299 service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:01.331538 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a6b2a507-2f1a-4d0e-858c-c0278857b3fe req-73839f7a-db45-4908-806f-5117dc10c299 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:01.331707 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:01.332101 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:01.332434 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-a6b2a507-2f1a-4d0e-858c-c0278857b3fe req-73839f7a-db45-4908-806f-5117dc10c299 service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:01.332582 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:01.333234 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:01.333692 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:01.334113 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:01.344703 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-a6b2a507-2f1a-4d0e-858c-c0278857b3fe req-73839f7a-db45-4908-806f-5117dc10c299 service nova] Creating event network-changed:a837cb16-3087-410e-8fd9-bd15170b5a41 for instance 93a36ee3-6446-492d-982a-83430d44aca9 on hv-cinder-85220 Sep 01 16:56:01.350515 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-a6b2a507-2f1a-4d0e-858c-c0278857b3fe req-73839f7a-db45-4908-806f-5117dc10c299 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034967 Sep 01 16:56:01.351666 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 607/1198] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:56:01.365532 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Going to try to terminate instance {{(pid=120693) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 16:56:01.460804 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-c9375496-6a67-483d-853d-8a085be8f9e9 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "DELETE /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 204 len: 0 microversion: 2.1 time: 0.146900 Sep 01 16:56:01.461657 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 592/1199] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:56:01 2022] DELETE /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 16:56:01.472180 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:01.473234 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:01.479940 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:01.480506 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:01.481170 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:01.482243 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:01.482541 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:01.483080 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:01.635886 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.policy [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120692) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:01.644387 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-7cd86fb0-8a95-4b0d-83fb-c41f6fac5ce2 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1577 microversion: 2.1 time: 0.177882 Sep 01 16:56:01.644973 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 608/1200] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:01 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:02.666093 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:02.666842 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:02.673857 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:02.674373 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:02.674798 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:02.675499 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:02.675947 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:02.676365 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:02.816818 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:02.824727 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-13a3b2f0-6fe1-45c4-b75c-ad5836553ebc tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1577 microversion: 2.1 time: 0.162828 Sep 01 16:56:02.825779 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 593/1201] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:02 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:03.787058 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [req-3deff58c-18d4-484a-b0c4-6ca340675a19 req-139867f4-c1d3-4935-8653-b8d6e081c82f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93a36ee3-6446-492d-982a-83430d44aca9", "name": "network-vif-deleted", "tag": "a837cb16-3087-410e-8fd9-bd15170b5a41"}]} {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 16:56:03.798828 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-3deff58c-18d4-484a-b0c4-6ca340675a19 req-139867f4-c1d3-4935-8653-b8d6e081c82f service nova] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:03.799098 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-3deff58c-18d4-484a-b0c4-6ca340675a19 req-139867f4-c1d3-4935-8653-b8d6e081c82f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:03.799487 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [req-3deff58c-18d4-484a-b0c4-6ca340675a19 req-139867f4-c1d3-4935-8653-b8d6e081c82f service nova] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:03.811107 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.compute.server_external_events [req-3deff58c-18d4-484a-b0c4-6ca340675a19 req-139867f4-c1d3-4935-8653-b8d6e081c82f service nova] Creating event network-vif-deleted:a837cb16-3087-410e-8fd9-bd15170b5a41 for instance 93a36ee3-6446-492d-982a-83430d44aca9 on hv-cinder-85220 Sep 01 16:56:03.816731 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [req-3deff58c-18d4-484a-b0c4-6ca340675a19 req-139867f4-c1d3-4935-8653-b8d6e081c82f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033337 Sep 01 16:56:03.817632 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 609/1202] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Sep 1 16:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 16:56:03.847756 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:03.849607 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:03.857878 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:03.858401 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:03.858833 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:03.859512 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:03.859989 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:03.860446 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:03.925785 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.policy [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa0f309a0b749b1a782d489f1f352af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20a271a8da6d423db38d5730006af839', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120693) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 16:56:03.933762 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8f5e38de-887e-4b4f-bd35-f75ef2b5ea3e tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 200 len: 1225 microversion: 2.1 time: 0.090937 Sep 01 16:56:03.934357 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 594/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:03 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 16:56:04.954720 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:04.955420 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 93a36ee3-6446-492d-982a-83430d44aca9] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:04.961780 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:04.962289 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:04.962725 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:04.963422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:04.963871 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:04.964290 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:04.978607 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] HTTP exception thrown: Instance 93a36ee3-6446-492d-982a-83430d44aca9 could not be found. Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Request method failure captured: Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 HTTP/1.1 Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOJH6ywePjbYRPznDq9A6engLpN0GrJh6lCheF-Kg9BxtkF4LJfkETkPWqyqm2ymL1L7fX4XGZpxZeqTwVIzNoVS41USCYsqD3ackVtYAFSPj9dXIkNREYD2dQauNsZLJZdwUFdffJ_H73Sn1TYXTxVrEJ2VEUUA62qZxWIjOxQbj8w Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:56:04.980249 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20a271a8da6d423db38d5730006af839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20a271a8da6d423db38d5730006af839", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}] Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 8fa0f309a0b749b1a782d489f1f352af Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 93a36ee3-6446-492d-982a-83430d44aca9 could not be found. Sep 01 16:56:04.981962 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '93a36ee3-6446-492d-982a-83430d44aca9'} Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93a36ee3-6446-492d-982a-83430d44aca9 could not be found. Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:04.982875 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93a36ee3-6446-492d-982a-83430d44aca9 could not be found. Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93a36ee3-6446-492d-982a-83430d44aca9 could not be found. Sep 01 16:56:04.985072 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:04.986637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Returning 404 to user: Instance 93a36ee3-6446-492d-982a-83430d44aca9 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:04.986637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-1242625b-ad58-4a1d-8e60-6d7eeee9cac8 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9" status: 404 len: 111 microversion: 2.1 time: 0.031748 Sep 01 16:56:04.986637 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 610/1204] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:04 2022] GET /compute/v2.1/servers/93a36ee3-6446-492d-982a-83430d44aca9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:05.442892 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:05.443465 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.compute.api [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120693) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:05.449954 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:05.450463 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:05.450901 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:05.451601 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:05.452576 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:05.453002 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG oslo_concurrency.lockutils [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120693) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:05.466962 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.wsgi [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] HTTP exception thrown: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Request method failure captured: Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: request: DELETE /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 HTTP/1.1 Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept: application/json Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Accept-Encoding: identity Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Connection: close Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Length: 0 Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Content-Type: application/json Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Host: 10.222.0.58 Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: Openstack-System-Scope: None Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Auth-Token: gAAAAABjEOJH6ywePjbYRPznDq9A6engLpN0GrJh6lCheF-Kg9BxtkF4LJfkETkPWqyqm2ymL1L7fX4XGZpxZeqTwVIzNoVS41USCYsqD3ackVtYAFSPj9dXIkNREYD2dQauNsZLJZdwUFdffJ_H73Sn1TYXTxVrEJ2VEUUA62qZxWIjOxQbj8w Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Id: None Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Domain-Name: None Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Identity-Status: Confirmed Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Is-Admin-Project: True Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Id: default Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Domain-Name: Default Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Project-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Role: reader,member Sep 01 16:56:05.469180 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Roles: reader,member Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20a271a8da6d423db38d5730006af839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20a271a8da6d423db38d5730006af839", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}] Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-Tenant-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Id: default Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Domain-Name: Default Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Id: 8fa0f309a0b749b1a782d489f1f352af Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: X-User-Name: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: method: > Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: exception: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.471044 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: action_args: {'id': '905d7b51-28e3-45cb-b5cc-194f938b63a0'} Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:05.472122 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.473902 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.475888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Returning 404 to user: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. {{(pid=120693) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:05.475888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-8c249414-b023-4d49-ab51-ad811de4403d tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "DELETE /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 404 len: 111 microversion: 2.1 time: 0.031612 Sep 01 16:56:05.475888 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 595/1205] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Sep 1 16:56:05 2022] DELETE /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:05.479605 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '>' {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:05.480218 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.compute.api [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] [instance: 905d7b51-28e3-45cb-b5cc-194f938b63a0] Fetching instance by UUID {{(pid=120692) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 16:56:05.486313 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:05.486795 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:05.487228 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:05.487919 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Acquiring lock "821da9c6-175b-449b-a524-866ff6db58f0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 16:56:05.488371 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 16:56:05.488808 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG oslo_concurrency.lockutils [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Lock "821da9c6-175b-449b-a524-866ff6db58f0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120692) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 16:56:05.505422 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.wsgi [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] HTTP exception thrown: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Request method failure captured: Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: request: GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 HTTP/1.1 Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept: application/json Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Accept-Encoding: identity Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Connection: close Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Length: 0 Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Content-Type: application/json Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Host: 10.222.0.58 Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: Openstack-System-Scope: None Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: User-Agent: python-urllib3/1.26.12 Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Auth-Token: gAAAAABjEOJH6ywePjbYRPznDq9A6engLpN0GrJh6lCheF-Kg9BxtkF4LJfkETkPWqyqm2ymL1L7fX4XGZpxZeqTwVIzNoVS41USCYsqD3ackVtYAFSPj9dXIkNREYD2dQauNsZLJZdwUFdffJ_H73Sn1TYXTxVrEJ2VEUUA62qZxWIjOxQbj8w Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Id: None Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Domain-Name: None Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Identity-Status: Confirmed Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Is-Admin-Project: True Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Id: default Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Domain-Name: Default Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Project-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Role: reader,member Sep 01 16:56:05.506986 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Roles: reader,member Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/20a271a8da6d423db38d5730006af839"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_20a271a8da6d423db38d5730006af839", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/20a271a8da6d423db38d5730006af839"}]}] Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Id: 20a271a8da6d423db38d5730006af839 Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-Tenant-Name: tempest-TestVolumeBootPattern-990473635 Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Id: default Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Domain-Name: Default Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Id: 8fa0f309a0b749b1a782d489f1f352af Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: X-User-Name: tempest-TestVolumeBootPattern-990473635-project Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: method: > Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: exception: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.509870 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: action_args: {'id': '905d7b51-28e3-45cb-b5cc-194f938b63a0'} Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: {{(pid=120692) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 16:56:05.510920 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. Sep 01 16:56:05.512672 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: ERROR nova.api.openstack.wsgi Sep 01 16:56:05.514161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: DEBUG nova.api.openstack.wsgi [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Returning 404 to user: Instance 905d7b51-28e3-45cb-b5cc-194f938b63a0 could not be found. {{(pid=120692) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 16:56:05.514161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: INFO nova.api.openstack.requestlog [None req-51f7375f-8b53-460c-8038-15d0b0a51596 tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0" status: 404 len: 111 microversion: 2.1 time: 0.032569 Sep 01 16:56:05.514161 dv-cinder-852208-16-iscsi devstack@n-api.service[120692]: [pid: 120692|app: 0|req: 611/1206] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Sep 1 16:56:05 2022] GET /compute/v2.1/servers/905d7b51-28e3-45cb-b5cc-194f938b63a0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 16:56:06.821240 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: DEBUG nova.api.openstack.wsgi [None req-15678674-4f2f-4482-9e3f-36ab16d32a5a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] Calling method '.version_select at 0x7f6c9ce7daf0>' {{(pid=120693) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 16:56:06.853058 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: INFO nova.api.openstack.requestlog [None req-15678674-4f2f-4482-9e3f-36ab16d32a5a tempest-TestVolumeBootPattern-990473635 tempest-TestVolumeBootPattern-990473635-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-442711278" status: 202 len: 0 microversion: 2.1 time: 0.035624 Sep 01 16:56:06.853652 dv-cinder-852208-16-iscsi devstack@n-api.service[120693]: [pid: 120693|app: 0|req: 596/1207] 10.222.0.58 () {58 vars in 1260 bytes} [Thu Sep 1 16:56:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-442711278 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)